2023-08-09T14:03:16.453 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-09T14:03:16.454 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_vshankar@teuthology --name vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168 --verbose -- /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168/orig.config.yaml 2023-08-09T14:03:16.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T14:03:16.582 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168 branch: wip-vshankar-testing-20230809.035933 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7364168' kernel: client: sha1: distro flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230809.035933 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230809.035933 sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8976 sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 sleep_before_teardown: 0 subset: 486/1024 suite: fs suite_branch: wip-vshankar-testing-20230809.035933 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi101.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-09_05:46:29 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-09T14:03:16.583 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa; will attempt to use it 2023-08-09T14:03:16.584 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa/tasks 2023-08-09T14:03:16.584 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-09T14:03:16.586 INFO:teuthology.task.internal:Checking packages... 2023-08-09T14:03:16.613 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '668a86f232c9454b2ce5928d1432a29a72964d85' 2023-08-09T14:03:16.613 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-09T14:03:16.613 INFO:teuthology.packaging:ref: None 2023-08-09T14:03:16.614 INFO:teuthology.packaging:tag: None 2023-08-09T14:03:16.614 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230809.035933 2023-08-09T14:03:16.614 INFO:teuthology.packaging:sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T14:03:16.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230809.035933 2023-08-09T14:03:16.777 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5389.g668a86f2 2023-08-09T14:03:16.777 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-09T14:03:16.783 INFO:teuthology.task.internal:no buildpackages task found 2023-08-09T14:03:16.784 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-09T14:03:16.789 INFO:teuthology.task.internal:Saving configuration 2023-08-09T14:03:16.809 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-09T14:03:16.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T14:03:16.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 13:58:15.431509', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-09T14:03:16.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 13:58:15.429903', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-09T14:03:16.863 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-09T14:03:16.869 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-09T14:03:16.870 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-09T14:03:16.870 INFO:teuthology.run_tasks:Running task console_log... 2023-08-09T14:03:16.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f66d1e6b040>, signals=[15]) 2023-08-09T14:03:16.939 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-09T14:03:16.947 INFO:teuthology.task.internal:Opening connections... 2023-08-09T14:03:16.948 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:03:16.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T14:03:17.021 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:03:17.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T14:03:17.087 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-09T14:03:17.094 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-08-09T14:03:17.117 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-08-09T14:03:17.117 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-08-09T14:03:17.177 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-08-09T14:03:17.177 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-08-09T14:03:17.177 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-08-09T14:03:17.178 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-08-09T14:03:17.178 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-08-09T14:03:17.178 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-08-09T14:03:17.178 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-09T14:03:17.178 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-09T14:03:17.179 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-09T14:03:17.180 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-09T14:03:17.180 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-08-09T14:03:17.216 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-08-09T14:03:17.238 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-08-09T14:03:17.238 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-08-09T14:03:17.298 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-09T14:03:17.299 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T14:03:17.300 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:03:17.300 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T14:03:17.300 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-09T14:03:17.300 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-09T14:03:17.300 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-09T14:03:17.301 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-08-09T14:03:17.324 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-09T14:03:17.337 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-09T14:03:17.343 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-09T14:03:17.343 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-08-09T14:03:17.346 DEBUG:teuthology.orchestra.run.smithi101:> test '!' -e /home/ubuntu/cephtest 2023-08-09T14:03:17.364 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-09T14:03:17.370 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-09T14:03:17.370 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-08-09T14:03:17.405 DEBUG:teuthology.orchestra.run.smithi101:> test -z $(ls -A /var/lib/ceph) 2023-08-09T14:03:17.431 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-09T14:03:17.486 INFO:teuthology.run_tasks:Running task kernel... 2023-08-09T14:03:17.501 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-09T14:03:17.502 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-08-09T14:03:17.502 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-08-09T14:03:17.503 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-09T14:03:17.504 DEBUG:teuthology.orchestra.run.smithi101:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-09T14:03:17.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:03:17.522 DEBUG:teuthology.orchestra.run.smithi101:> uname -r 2023-08-09T14:03:17.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:03:17.523 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-08-09T14:03:17.580 INFO:teuthology.orchestra.run.smithi101.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:17.580 INFO:teuthology.task.kernel:Running kernel on smithi101: 4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:17.581 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum install -y kernel 2023-08-09T14:03:17.582 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:17.583 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:17.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2023-08-09T14:03:18.743 INFO:teuthology.orchestra.run.smithi101.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:18.743 INFO:teuthology.orchestra.run.smithi101.stdout:Unable to read consumer identity 2023-08-09T14:03:18.853 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:18.854 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-08-09T14:03:20.145 INFO:teuthology.orchestra.run.smithi101.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-08-09T14:03:20.345 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-08-09T14:03:21.221 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-08-09T14:03:21.895 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-08-09T14:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 380 kB/s | 24 kB 00:00 2023-08-09T14:03:25.328 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 412 kB/s | 24 kB 00:00 2023-08-09T14:03:25.590 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-09T14:03:25.646 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-08-09T14:03:25.647 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-08-09T14:03:25.647 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-08-09T14:03:25.777 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2023-08-09T14:03:26.011 INFO:teuthology.orchestra.run.smithi101.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-09T14:03:26.067 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2023-08-09T14:03:26.068 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2023-08-09T14:03:26.068 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2023-08-09T14:03:26.167 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:26.168 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-08-09T14:03:26.192 DEBUG:teuthology.orchestra.run.smithi101:> echo no | sudo yum reinstall kernel || true 2023-08-09T14:03:26.436 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:02 ago on Wed 09 Aug 2023 02:03:24 PM UTC. 2023-08-09T14:03:26.481 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-09T14:03:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-08-09T14:03:26.521 INFO:teuthology.orchestra.run.smithi101.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:26.521 INFO:teuthology.orchestra.run.smithi101.stdout:Unable to read consumer identity 2023-08-09T14:03:26.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2023-08-09T14:03:26.775 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:00:01 ago on Wed 09 Aug 2023 02:03:25 PM UTC. 2023-08-09T14:03:26.816 INFO:teuthology.orchestra.run.smithi101.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-09T14:03:26.851 INFO:teuthology.orchestra.run.smithi101.stderr:Error: No packages marked for reinstall. 2023-08-09T14:03:26.902 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum reinstall -y kernel || true 2023-08-09T14:03:26.909 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:26.909 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-08-09T14:03:27.180 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:03 ago on Wed 09 Aug 2023 02:03:24 PM UTC. 2023-08-09T14:03:27.224 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-09T14:03:27.233 INFO:teuthology.orchestra.run.smithi101.stdout:Updating Subscription Management repositories. 2023-08-09T14:03:27.233 INFO:teuthology.orchestra.run.smithi101.stdout:Unable to read consumer identity 2023-08-09T14:03:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-08-09T14:03:27.304 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2023-08-09T14:03:27.386 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:27.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:27.387 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-09T14:03:27.387 DEBUG:teuthology.parallel:result is None 2023-08-09T14:03:27.484 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:00:02 ago on Wed 09 Aug 2023 02:03:25 PM UTC. 2023-08-09T14:03:27.524 INFO:teuthology.orchestra.run.smithi101.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-09T14:03:27.549 INFO:teuthology.orchestra.run.smithi101.stderr:Error: No packages marked for reinstall. 2023-08-09T14:03:27.599 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q kernel | sort -rV | head -n 1 2023-08-09T14:03:27.679 INFO:teuthology.orchestra.run.smithi101.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:27.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-09T14:03:27.679 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-09T14:03:27.680 DEBUG:teuthology.parallel:result is None 2023-08-09T14:03:27.680 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-09T14:03:27.688 INFO:teuthology.task.internal:Creating test directory... 2023-08-09T14:03:27.688 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-09T14:03:27.691 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-09T14:03:27.707 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-09T14:03:27.714 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-09T14:03:27.723 INFO:teuthology.task.internal:Creating archive directory... 2023-08-09T14:03:27.723 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-09T14:03:27.749 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-09T14:03:27.781 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-09T14:03:27.788 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-09T14:03:27.789 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-09T14:03:27.813 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-09T14:03:27.851 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T14:03:27.858 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T14:03:27.867 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T14:03:27.877 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T14:03:27.878 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-09T14:03:27.885 INFO:teuthology.task.internal:Configuring sudo... 2023-08-09T14:03:27.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-09T14:03:27.888 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-09T14:03:27.937 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-09T14:03:27.948 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-09T14:03:27.948 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-09T14:03:27.957 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-09T14:03:27.993 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T14:03:28.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T14:03:28.103 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T14:03:28.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T14:03:28.229 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:03:28.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-09T14:03:28.297 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T14:03:28.339 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T14:03:28.409 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T14:03:28.450 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T14:03:28.492 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:03:28.493 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-09T14:03:28.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-08-09T14:03:28.566 DEBUG:teuthology.orchestra.run.smithi101:> sudo service rsyslog restart 2023-08-09T14:03:28.638 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T14:03:28.656 INFO:teuthology.orchestra.run.smithi101.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T14:03:28.895 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-09T14:03:28.905 INFO:teuthology.task.internal:Starting timer... 2023-08-09T14:03:28.905 INFO:teuthology.run_tasks:Running task pcp... 2023-08-09T14:03:28.919 INFO:teuthology.run_tasks:Running task selinux... 2023-08-09T14:03:28.963 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-08-09T14:03:28.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-08-09T14:03:29.028 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-08-09T14:03:29.030 DEBUG:teuthology.orchestra.run.smithi101:> sudo service auditd rotate 2023-08-09T14:03:29.082 INFO:teuthology.orchestra.run.smithi101.stdout:Rotating logs: 2023-08-09T14:03:29.084 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-09T14:03:29.084 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-08-09T14:03:29.110 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-08-09T14:03:29.111 DEBUG:teuthology.orchestra.run.smithi101:> /usr/sbin/getenforce 2023-08-09T14:03:29.133 INFO:teuthology.orchestra.run.smithi101.stdout:Permissive 2023-08-09T14:03:29.134 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi101.front.sepia.ceph.com': 'permissive'} 2023-08-09T14:03:29.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T14:03:29.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:03:29.179 DEBUG:teuthology.orchestra.run.smithi101:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T14:03:29.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:03:29.206 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-09T14:03:29.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-08-09T14:03:29.249 DEBUG:teuthology.orchestra.run.smithi101:> sudo /usr/sbin/setenforce permissive 2023-08-09T14:03:29.275 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-09T14:03:29.300 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-09T14:03:29.306 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-09T14:03:29.440 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-09T14:03:29.458 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-09T14:03:29.459 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi101.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-09T14:12:11.043 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi101.front.sepia.ceph.com')] 2023-08-09T14:12:11.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-08-09T14:12:11.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T14:12:11.115 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-08-09T14:12:11.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-08-09T14:12:11.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-09T14:12:11.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T14:12:11.259 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-08-09T14:12:11.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-09T14:12:11.327 INFO:teuthology.run_tasks:Running task clock... 2023-08-09T14:12:11.337 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-09T14:12:11.338 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-09T14:12:11.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T14:12:11.341 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-09T14:12:11.341 DEBUG:teuthology.orchestra.run.smithi101:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T14:12:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-09T14:12:11.394 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-09T14:12:11.399 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-09T14:12:11.413 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-09T14:12:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-08-09T14:12:11.479 INFO:teuthology.orchestra.run.smithi101.stderr:sudo: ntpd: command not found 2023-08-09T14:12:11.483 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-08-09T14:12:11.491 INFO:teuthology.orchestra.run.smithi101.stdout:506 Cannot talk to daemon 2023-08-09T14:12:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-09T14:12:11.506 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-09T14:12:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-09T14:12:11.519 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-09T14:12:11.598 INFO:teuthology.orchestra.run.smithi101.stderr:bash: ntpq: command not found 2023-08-09T14:12:11.601 INFO:teuthology.orchestra.run.smithi101.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T14:12:11.601 INFO:teuthology.orchestra.run.smithi101.stdout:=============================================================================== 2023-08-09T14:12:11.602 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.602 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.602 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.602 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.607 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T14:12:11.612 INFO:teuthology.run_tasks:Running task install... 2023-08-09T14:12:11.620 DEBUG:teuthology.task.install:project ceph 2023-08-09T14:12:11.621 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}} 2023-08-09T14:12:11.621 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'} 2023-08-09T14:12:11.621 INFO:teuthology.task.install:Using flavor: default 2023-08-09T14:12:11.627 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-09T14:12:11.628 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-09T14:12:11.628 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'tag': None, 'wait_for_package': False} 2023-08-09T14:12:11.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T14:12:11.631 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'tag': None, 'wait_for_package': False} 2023-08-09T14:12:11.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T14:12:11.774 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/ 2023-08-09T14:12:11.774 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5389.g668a86f2 2023-08-09T14:12:11.846 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/ 2023-08-09T14:12:11.847 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5389.g668a86f2 2023-08-09T14:12:11.951 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-09T14:12:11.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:12:11.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-09T14:12:11.955 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-09T14:12:11.955 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:12:11.955 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-09T14:12:11.983 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-09T14:12:11.983 DEBUG:teuthology.orchestra.run.smithi101:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/668a86f232c9454b2ce5928d1432a29a72964d85/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-09T14:12:11.987 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-09T14:12:11.987 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/668a86f232c9454b2ce5928d1432a29a72964d85/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-09T14:12:12.050 DEBUG:teuthology.orchestra.run.smithi101:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-09T14:12:12.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-09T14:12:12.127 DEBUG:teuthology.orchestra.run.smithi101:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-09T14:12:12.142 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-09T14:12:12.193 INFO:teuthology.orchestra.run.smithi101.stdout:check_obsoletes = 1 2023-08-09T14:12:12.194 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum clean all 2023-08-09T14:12:12.213 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-08-09T14:12:12.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-08-09T14:12:12.564 INFO:teuthology.orchestra.run.smithi101.stdout:Updating Subscription Management repositories. 2023-08-09T14:12:12.609 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:12:12.832 INFO:teuthology.orchestra.run.smithi101.stdout:44 files removed 2023-08-09T14:12:12.843 INFO:teuthology.orchestra.run.smithi005.stdout:44 files removed 2023-08-09T14:12:12.878 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-09T14:12:12.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-09T14:12:13.207 INFO:teuthology.orchestra.run.smithi101.stdout:Updating Subscription Management repositories. 2023-08-09T14:12:13.239 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:12:13.899 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 284 kB/s | 81 kB 00:00 2023-08-09T14:12:13.997 INFO:teuthology.orchestra.run.smithi101.stdout:ceph packages for x86_64 185 kB/s | 81 kB 00:00 2023-08-09T14:12:14.230 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-08-09T14:12:14.306 INFO:teuthology.orchestra.run.smithi101.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-08-09T14:12:14.582 INFO:teuthology.orchestra.run.smithi101.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2023-08-09T14:12:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2023-08-09T14:12:14.733 INFO:teuthology.orchestra.run.smithi101.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-09T14:12:14.764 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-09T14:12:16.426 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-08-09T14:12:16.533 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 16 MB 00:01 2023-08-09T14:12:20.000 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 340 kB/s | 24 kB 00:00 2023-08-09T14:12:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 256 kB/s | 24 kB 00:00 2023-08-09T14:12:20.894 INFO:teuthology.orchestra.run.smithi101.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-08-09T14:12:21.201 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-08-09T14:12:29.043 INFO:teuthology.orchestra.run.smithi101.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-08-09T14:12:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-08-09T14:12:40.055 INFO:teuthology.orchestra.run.smithi101.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-09T14:12:40.057 INFO:teuthology.orchestra.run.smithi101.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-09T14:12:40.071 INFO:teuthology.orchestra.run.smithi101.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-09T14:12:40.072 INFO:teuthology.orchestra.run.smithi101.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-09T14:12:40.074 INFO:teuthology.orchestra.run.smithi101.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-09T14:12:40.075 INFO:teuthology.orchestra.run.smithi101.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-09T14:12:40.077 INFO:teuthology.orchestra.run.smithi101.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-09T14:12:40.081 INFO:teuthology.orchestra.run.smithi101.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-09T14:12:40.082 INFO:teuthology.orchestra.run.smithi101.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-09T14:12:40.216 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2023-08-09T14:12:40.228 INFO:teuthology.orchestra.run.smithi101.stdout:=========================================================================================================================== 2023-08-09T14:12:40.228 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout:=========================================================================================================================== 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: ceph x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 6.4 k 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 5.4 M 2023-08-09T14:12:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 860 k 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 167 k 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 1.6 M 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 130 k 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 1.7 M 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 7.4 M 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 47 k 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 14 M 2023-08-09T14:12:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 48 M 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-volume noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 261 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 166 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: cephfs-mirror x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 260 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: cephfs-top noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 18 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-09T14:12:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 31 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 782 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 139 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-09T14:12:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 197 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 372 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 364 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 107 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 93 k 2023-08-09T14:12:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.5 M 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 179 k 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrading: 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: librados2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.7 M 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.6 M 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2023-08-09T14:12:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 22 M 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 23 k 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 2.3 M 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 241 k 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 4.6 M 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 18 M 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 15 k 2023-08-09T14:12:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 24 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 139 k 2023-08-09T14:12:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 473 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-09T14:12:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 6.8 M 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-09T14:12:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-09T14:12:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 45 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 124 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-09T14:12:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-09T14:12:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-09T14:12:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-09T14:12:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-09T14:12:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-09T14:12:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-09T14:12:40.246 INFO:teuthology.orchestra.run.smithi101.stdout:Enabling module streams: 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql 10 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout:=========================================================================================================================== 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout:Install 128 Packages 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrade 3 Packages 2023-08-09T14:12:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:12:40.248 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 206 M 2023-08-09T14:12:40.248 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2023-08-09T14:12:40.454 INFO:teuthology.orchestra.run.smithi101.stdout:(1/131): ceph-18.0.0-5389.g668a86f2.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-08-09T14:12:40.787 INFO:teuthology.orchestra.run.smithi101.stdout:(2/131): ceph-fuse-18.0.0-5389.g668a86f2.el8.x8 2.5 MB/s | 860 kB 00:00 2023-08-09T14:12:40.871 INFO:teuthology.orchestra.run.smithi101.stdout:(3/131): ceph-immutable-object-cache-18.0.0-538 2.0 MB/s | 167 kB 00:00 2023-08-09T14:12:40.946 INFO:teuthology.orchestra.run.smithi101.stdout:(4/131): ceph-base-18.0.0-5389.g668a86f2.el8.x8 8.0 MB/s | 5.4 MB 00:00 2023-08-09T14:12:41.113 INFO:teuthology.orchestra.run.smithi101.stdout:(5/131): ceph-mgr-18.0.0-5389.g668a86f2.el8.x86 9.4 MB/s | 1.6 MB 00:00 2023-08-09T14:12:41.497 INFO:teuthology.orchestra.run.smithi101.stdout:(6/131): ceph-mds-18.0.0-5389.g668a86f2.el8.x86 3.7 MB/s | 2.3 MB 00:00 2023-08-09T14:12:41.572 INFO:teuthology.orchestra.run.smithi101.stdout:(7/131): ceph-mon-18.0.0-5389.g668a86f2.el8.x86 10 MB/s | 4.6 MB 00:00 2023-08-09T14:12:42.410 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-09T14:12:42.411 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-09T14:12:42.426 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-09T14:12:42.427 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-09T14:12:42.428 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-09T14:12:42.430 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-09T14:12:42.432 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-09T14:12:42.435 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-09T14:12:42.436 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-09T14:12:42.576 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-08-09T14:12:42.589 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-08-09T14:12:42.589 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-08-09T14:12:42.589 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 6.4 k 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 5.4 M 2023-08-09T14:12:42.590 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 860 k 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 167 k 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 1.6 M 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 130 k 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 1.7 M 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 7.4 M 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 47 k 2023-08-09T14:12:42.591 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 14 M 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 48 M 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 261 k 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 166 k 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 260 k 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 18 k 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-09T14:12:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-09T14:12:42.593 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-09T14:12:42.593 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 31 k 2023-08-09T14:12:42.593 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 782 k 2023-08-09T14:12:42.593 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 139 k 2023-08-09T14:12:42.593 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-09T14:12:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-09T14:12:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-09T14:12:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-09T14:12:42.595 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-09T14:12:42.595 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-09T14:12:42.596 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 197 k 2023-08-09T14:12:42.596 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 372 k 2023-08-09T14:12:42.596 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 364 k 2023-08-09T14:12:42.596 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 107 k 2023-08-09T14:12:42.597 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 93 k 2023-08-09T14:12:42.597 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.5 M 2023-08-09T14:12:42.597 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 179 k 2023-08-09T14:12:42.597 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-09T14:12:42.597 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-08-09T14:12:42.598 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-09T14:12:42.598 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.7 M 2023-08-09T14:12:42.598 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 3.6 M 2023-08-09T14:12:42.598 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-08-09T14:12:42.598 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 22 M 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 23 k 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 2.3 M 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 241 k 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 4.6 M 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 18 M 2023-08-09T14:12:42.599 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5389.g668a86f2.el8 ceph-noarch 15 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 24 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-09T14:12:42.600 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 139 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-09T14:12:42.601 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 473 k 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 6.8 M 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-09T14:12:42.602 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-09T14:12:42.603 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-09T14:12:42.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 45 k 2023-08-09T14:12:42.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-5389.g668a86f2.el8 ceph 124 k 2023-08-09T14:12:42.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-09T14:12:42.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-09T14:12:42.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-09T14:12:42.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-09T14:12:42.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-09T14:12:42.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-09T14:12:42.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-09T14:12:42.609 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-09T14:12:42.609 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-09T14:12:42.609 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-09T14:12:42.610 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-09T14:12:42.610 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-09T14:12:42.610 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-09T14:12:42.610 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-09T14:12:42.611 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-09T14:12:42.612 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2023-08-09T14:12:42.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:12:42.614 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-08-09T14:12:42.614 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-08-09T14:12:42.614 INFO:teuthology.orchestra.run.smithi005.stdout:Install 128 Packages 2023-08-09T14:12:42.614 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 3 Packages 2023-08-09T14:12:42.615 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:12:42.616 INFO:teuthology.orchestra.run.smithi101.stdout:(8/131): ceph-common-18.0.0-5389.g668a86f2.el8. 9.5 MB/s | 22 MB 00:02 2023-08-09T14:12:42.616 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 206 M 2023-08-09T14:12:42.616 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-08-09T14:12:42.648 INFO:teuthology.orchestra.run.smithi101.stdout:(9/131): ceph-selinux-18.0.0-5389.g668a86f2.el8 588 kB/s | 24 kB 00:00 2023-08-09T14:12:42.923 INFO:teuthology.orchestra.run.smithi101.stdout:(10/131): ceph-radosgw-18.0.0-5389.g668a86f2.el 10 MB/s | 14 MB 00:01 2023-08-09T14:12:42.927 INFO:teuthology.orchestra.run.smithi005.stdout:(1/131): ceph-18.0.0-5389.g668a86f2.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-08-09T14:12:43.024 INFO:teuthology.orchestra.run.smithi101.stdout:(11/131): cephfs-mirror-18.0.0-5389.g668a86f2.e 2.5 MB/s | 260 kB 00:00 2023-08-09T14:12:43.107 INFO:teuthology.orchestra.run.smithi101.stdout:(12/131): libcephfs-devel-18.0.0-5389.g668a86f2 373 kB/s | 31 kB 00:00 2023-08-09T14:12:43.324 INFO:teuthology.orchestra.run.smithi101.stdout:(13/131): libcephfs2-18.0.0-5389.g668a86f2.el8. 3.5 MB/s | 782 kB 00:00 2023-08-09T14:12:43.449 INFO:teuthology.orchestra.run.smithi101.stdout:(14/131): libcephsqlite-18.0.0-5389.g668a86f2.e 1.1 MB/s | 139 kB 00:00 2023-08-09T14:12:43.566 INFO:teuthology.orchestra.run.smithi101.stdout:(15/131): librados-devel-18.0.0-5389.g668a86f2. 1.2 MB/s | 139 kB 00:00 2023-08-09T14:12:43.810 INFO:teuthology.orchestra.run.smithi005.stdout:(2/131): ceph-fuse-18.0.0-5389.g668a86f2.el8.x8 974 kB/s | 860 kB 00:00 2023-08-09T14:12:43.842 INFO:teuthology.orchestra.run.smithi101.stdout:(16/131): libradosstriper1-18.0.0-5389.g668a86f 1.7 MB/s | 473 kB 00:00 2023-08-09T14:12:44.019 INFO:teuthology.orchestra.run.smithi005.stdout:(3/131): ceph-immutable-object-cache-18.0.0-538 801 kB/s | 167 kB 00:00 2023-08-09T14:12:44.467 INFO:teuthology.orchestra.run.smithi101.stdout:(17/131): ceph-osd-18.0.0-5389.g668a86f2.el8.x8 6.0 MB/s | 18 MB 00:02 2023-08-09T14:12:44.511 INFO:teuthology.orchestra.run.smithi005.stdout:(4/131): ceph-base-18.0.0-5389.g668a86f2.el8.x8 2.9 MB/s | 5.4 MB 00:01 2023-08-09T14:12:44.559 INFO:teuthology.orchestra.run.smithi101.stdout:(18/131): python3-ceph-argparse-18.0.0-5389.g66 489 kB/s | 45 kB 00:00 2023-08-09T14:12:44.676 INFO:teuthology.orchestra.run.smithi101.stdout:(19/131): python3-ceph-common-18.0.0-5389.g668a 1.0 MB/s | 124 kB 00:00 2023-08-09T14:12:44.801 INFO:teuthology.orchestra.run.smithi101.stdout:(20/131): python3-cephfs-18.0.0-5389.g668a86f2. 1.5 MB/s | 197 kB 00:00 2023-08-09T14:12:44.943 INFO:teuthology.orchestra.run.smithi101.stdout:(21/131): python3-rados-18.0.0-5389.g668a86f2.e 2.6 MB/s | 372 kB 00:00 2023-08-09T14:12:44.961 INFO:teuthology.orchestra.run.smithi005.stdout:(5/131): ceph-mgr-18.0.0-5389.g668a86f2.el8.x86 3.5 MB/s | 1.6 MB 00:00 2023-08-09T14:12:45.036 INFO:teuthology.orchestra.run.smithi101.stdout:(22/131): python3-rbd-18.0.0-5389.g668a86f2.el8 3.9 MB/s | 364 kB 00:00 2023-08-09T14:12:45.153 INFO:teuthology.orchestra.run.smithi101.stdout:(23/131): python3-rgw-18.0.0-5389.g668a86f2.el8 913 kB/s | 107 kB 00:00 2023-08-09T14:12:45.253 INFO:teuthology.orchestra.run.smithi101.stdout:(24/131): rbd-fuse-18.0.0-5389.g668a86f2.el8.x8 935 kB/s | 93 kB 00:00 2023-08-09T14:12:45.520 INFO:teuthology.orchestra.run.smithi005.stdout:(6/131): ceph-mds-18.0.0-5389.g668a86f2.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-08-09T14:12:45.628 INFO:teuthology.orchestra.run.smithi101.stdout:(25/131): librgw2-18.0.0-5389.g668a86f2.el8.x86 3.8 MB/s | 6.8 MB 00:01 2023-08-09T14:12:45.712 INFO:teuthology.orchestra.run.smithi101.stdout:(26/131): rbd-nbd-18.0.0-5389.g668a86f2.el8.x86 2.1 MB/s | 179 kB 00:00 2023-08-09T14:12:45.779 INFO:teuthology.orchestra.run.smithi101.stdout:(27/131): rbd-mirror-18.0.0-5389.g668a86f2.el8. 6.7 MB/s | 3.5 MB 00:00 2023-08-09T14:12:45.804 INFO:teuthology.orchestra.run.smithi101.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5389.g 250 kB/s | 23 kB 00:00 2023-08-09T14:12:45.863 INFO:teuthology.orchestra.run.smithi101.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5389.g668a86f 1.5 MB/s | 130 kB 00:00 2023-08-09T14:12:46.255 INFO:teuthology.orchestra.run.smithi101.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5389.g668a8 3.9 MB/s | 1.7 MB 00:00 2023-08-09T14:12:46.346 INFO:teuthology.orchestra.run.smithi005.stdout:(7/131): ceph-mon-18.0.0-5389.g668a86f2.el8.x86 3.3 MB/s | 4.6 MB 00:01 2023-08-09T14:12:46.355 INFO:teuthology.orchestra.run.smithi101.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5389.g66 2.4 MB/s | 241 kB 00:00 2023-08-09T14:12:46.439 INFO:teuthology.orchestra.run.smithi101.stdout:(32/131): ceph-mgr-rook-18.0.0-5389.g668a86f2.e 568 kB/s | 47 kB 00:00 2023-08-09T14:12:46.531 INFO:teuthology.orchestra.run.smithi101.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5389.g6 158 kB/s | 15 kB 00:00 2023-08-09T14:12:46.981 INFO:teuthology.orchestra.run.smithi101.stdout:(34/131): ceph-test-18.0.0-5389.g668a86f2.el8.x 11 MB/s | 48 MB 00:04 2023-08-09T14:12:47.006 INFO:teuthology.orchestra.run.smithi101.stdout:(35/131): ceph-volume-18.0.0-5389.g668a86f2.el8 548 kB/s | 261 kB 00:00 2023-08-09T14:12:47.032 INFO:teuthology.orchestra.run.smithi101.stdout:(36/131): cephadm-18.0.0-5389.g668a86f2.el8.noa 3.2 MB/s | 166 kB 00:00 2023-08-09T14:12:47.057 INFO:teuthology.orchestra.run.smithi101.stdout:(37/131): cephfs-top-18.0.0-5389.g668a86f2.el8. 357 kB/s | 18 kB 00:00 2023-08-09T14:12:47.149 INFO:teuthology.orchestra.run.smithi101.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-08-09T14:12:47.316 INFO:teuthology.orchestra.run.smithi101.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 227 kB/s | 59 kB 00:00 2023-08-09T14:12:47.358 INFO:teuthology.orchestra.run.smithi101.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 360 kB/s | 75 kB 00:00 2023-08-09T14:12:47.500 INFO:teuthology.orchestra.run.smithi101.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 654 kB/s | 306 kB 00:00 2023-08-09T14:12:47.526 INFO:teuthology.orchestra.run.smithi101.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 260 kB/s | 44 kB 00:00 2023-08-09T14:12:47.601 INFO:teuthology.orchestra.run.smithi101.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-08-09T14:12:47.626 INFO:teuthology.orchestra.run.smithi101.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-08-09T14:12:47.685 INFO:teuthology.orchestra.run.smithi101.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-08-09T14:12:47.710 INFO:teuthology.orchestra.run.smithi101.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-08-09T14:12:47.769 INFO:teuthology.orchestra.run.smithi005.stdout:(8/131): ceph-common-18.0.0-5389.g668a86f2.el8. 4.3 MB/s | 22 MB 00:05 2023-08-09T14:12:47.777 INFO:teuthology.orchestra.run.smithi101.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-08-09T14:12:47.802 INFO:teuthology.orchestra.run.smithi101.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 882 kB/s | 81 kB 00:00 2023-08-09T14:12:47.820 INFO:teuthology.orchestra.run.smithi005.stdout:(9/131): ceph-selinux-18.0.0-5389.g668a86f2.el8 475 kB/s | 24 kB 00:00 2023-08-09T14:12:47.828 INFO:teuthology.orchestra.run.smithi101.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-08-09T14:12:47.864 INFO:teuthology.orchestra.run.smithi101.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 132 kB/s | 11 kB 00:00 2023-08-09T14:12:47.887 INFO:teuthology.orchestra.run.smithi101.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 209 kB/s | 18 kB 00:00 2023-08-09T14:12:47.970 INFO:teuthology.orchestra.run.smithi101.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 704 kB/s | 59 kB 00:00 2023-08-09T14:12:48.021 INFO:teuthology.orchestra.run.smithi101.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.0 MB/s | 1.2 MB 00:00 2023-08-09T14:12:48.038 INFO:teuthology.orchestra.run.smithi101.stdout:(54/131): python3-logutils-0.3.5-11.el8.noarch. 277 kB/s | 49 kB 00:00 2023-08-09T14:12:48.055 INFO:teuthology.orchestra.run.smithi101.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 717 kB/s | 60 kB 00:00 2023-08-09T14:12:48.122 INFO:teuthology.orchestra.run.smithi101.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-08-09T14:12:48.139 INFO:teuthology.orchestra.run.smithi101.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 402 kB/s | 34 kB 00:00 2023-08-09T14:12:48.146 INFO:teuthology.orchestra.run.smithi005.stdout:(10/131): ceph-radosgw-18.0.0-5389.g668a86f2.el 7.5 MB/s | 14 MB 00:01 2023-08-09T14:12:48.181 INFO:teuthology.orchestra.run.smithi101.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-08-09T14:12:48.206 INFO:teuthology.orchestra.run.smithi101.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 959 kB/s | 64 kB 00:00 2023-08-09T14:12:48.213 INFO:teuthology.orchestra.run.smithi005.stdout:(11/131): cephfs-mirror-18.0.0-5389.g668a86f2.e 3.8 MB/s | 260 kB 00:00 2023-08-09T14:12:48.240 INFO:teuthology.orchestra.run.smithi101.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-08-09T14:12:48.263 INFO:teuthology.orchestra.run.smithi005.stdout:(12/131): libcephfs-devel-18.0.0-5389.g668a86f2 625 kB/s | 31 kB 00:00 2023-08-09T14:12:48.273 INFO:teuthology.orchestra.run.smithi101.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-08-09T14:12:48.299 INFO:teuthology.orchestra.run.smithi101.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-08-09T14:12:48.324 INFO:teuthology.orchestra.run.smithi101.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-08-09T14:12:48.382 INFO:teuthology.orchestra.run.smithi101.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-08-09T14:12:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:(13/131): libcephfs2-18.0.0-5389.g668a86f2.el8. 6.1 MB/s | 782 kB 00:00 2023-08-09T14:12:48.408 INFO:teuthology.orchestra.run.smithi101.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-08-09T14:12:48.433 INFO:teuthology.orchestra.run.smithi101.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-08-09T14:12:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:(14/131): libcephsqlite-18.0.0-5389.g668a86f2.e 2.7 MB/s | 139 kB 00:00 2023-08-09T14:12:48.475 INFO:teuthology.orchestra.run.smithi101.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 665 kB/s | 61 kB 00:00 2023-08-09T14:12:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:(15/131): librados-devel-18.0.0-5389.g668a86f2. 2.7 MB/s | 139 kB 00:00 2023-08-09T14:12:48.500 INFO:teuthology.orchestra.run.smithi101.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 926 kB/s | 85 kB 00:00 2023-08-09T14:12:48.517 INFO:teuthology.orchestra.run.smithi101.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-08-09T14:12:48.542 INFO:teuthology.orchestra.run.smithi101.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2023-08-09T14:12:48.585 INFO:teuthology.orchestra.run.smithi101.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-08-09T14:12:48.596 INFO:teuthology.orchestra.run.smithi005.stdout:(16/131): libradosstriper1-18.0.0-5389.g668a86f 4.3 MB/s | 473 kB 00:00 2023-08-09T14:12:48.635 INFO:teuthology.orchestra.run.smithi101.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 399 kB/s | 47 kB 00:00 2023-08-09T14:12:48.669 INFO:teuthology.orchestra.run.smithi101.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-08-09T14:12:48.694 INFO:teuthology.orchestra.run.smithi101.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 435 kB/s | 43 kB 00:00 2023-08-09T14:12:48.719 INFO:teuthology.orchestra.run.smithi101.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-08-09T14:12:48.736 INFO:teuthology.orchestra.run.smithi101.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-09T14:12:48.762 INFO:teuthology.orchestra.run.smithi101.stdout:(77/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-08-09T14:12:48.787 INFO:teuthology.orchestra.run.smithi101.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 635 kB/s | 43 kB 00:00 2023-08-09T14:12:48.812 INFO:teuthology.orchestra.run.smithi101.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-08-09T14:12:48.837 INFO:teuthology.orchestra.run.smithi101.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-08-09T14:12:48.854 INFO:teuthology.orchestra.run.smithi101.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 446 kB/s | 19 kB 00:00 2023-08-09T14:12:48.880 INFO:teuthology.orchestra.run.smithi101.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-08-09T14:12:48.913 INFO:teuthology.orchestra.run.smithi101.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-08-09T14:12:48.930 INFO:teuthology.orchestra.run.smithi101.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 355 kB/s | 18 kB 00:00 2023-08-09T14:12:48.964 INFO:teuthology.orchestra.run.smithi101.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-08-09T14:12:48.989 INFO:teuthology.orchestra.run.smithi101.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-09T14:12:49.015 INFO:teuthology.orchestra.run.smithi101.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-08-09T14:12:49.040 INFO:teuthology.orchestra.run.smithi101.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-08-09T14:12:49.090 INFO:teuthology.orchestra.run.smithi101.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-08-09T14:12:49.116 INFO:teuthology.orchestra.run.smithi101.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 796 kB/s | 60 kB 00:00 2023-08-09T14:12:49.141 INFO:teuthology.orchestra.run.smithi101.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-08-09T14:12:49.166 INFO:teuthology.orchestra.run.smithi101.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-08-09T14:12:49.191 INFO:teuthology.orchestra.run.smithi101.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-08-09T14:12:49.225 INFO:teuthology.orchestra.run.smithi101.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-08-09T14:12:49.250 INFO:teuthology.orchestra.run.smithi101.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-08-09T14:12:49.273 INFO:teuthology.orchestra.run.smithi005.stdout:(17/131): librgw2-18.0.0-5389.g668a86f2.el8.x86 10 MB/s | 6.8 MB 00:00 2023-08-09T14:12:49.276 INFO:teuthology.orchestra.run.smithi101.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-08-09T14:12:49.323 INFO:teuthology.orchestra.run.smithi005.stdout:(18/131): python3-ceph-argparse-18.0.0-5389.g66 898 kB/s | 45 kB 00:00 2023-08-09T14:12:49.334 INFO:teuthology.orchestra.run.smithi101.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2023-08-09T14:12:49.360 INFO:teuthology.orchestra.run.smithi101.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-08-09T14:12:49.381 INFO:teuthology.orchestra.run.smithi005.stdout:(19/131): python3-ceph-common-18.0.0-5389.g668a 2.1 MB/s | 124 kB 00:00 2023-08-09T14:12:49.385 INFO:teuthology.orchestra.run.smithi101.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2023-08-09T14:12:49.411 INFO:teuthology.orchestra.run.smithi101.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-08-09T14:12:49.444 INFO:teuthology.orchestra.run.smithi101.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-09T14:12:49.449 INFO:teuthology.orchestra.run.smithi005.stdout:(20/131): python3-cephfs-18.0.0-5389.g668a86f2. 2.9 MB/s | 197 kB 00:00 2023-08-09T14:12:49.469 INFO:teuthology.orchestra.run.smithi101.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-08-09T14:12:49.512 INFO:teuthology.orchestra.run.smithi101.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-08-09T14:12:49.524 INFO:teuthology.orchestra.run.smithi005.stdout:(21/131): python3-rados-18.0.0-5389.g668a86f2.e 4.9 MB/s | 372 kB 00:00 2023-08-09T14:12:49.545 INFO:teuthology.orchestra.run.smithi101.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-08-09T14:12:49.570 INFO:teuthology.orchestra.run.smithi101.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-09T14:12:49.596 INFO:teuthology.orchestra.run.smithi101.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-08-09T14:12:49.599 INFO:teuthology.orchestra.run.smithi005.stdout:(22/131): python3-rbd-18.0.0-5389.g668a86f2.el8 4.7 MB/s | 364 kB 00:00 2023-08-09T14:12:49.629 INFO:teuthology.orchestra.run.smithi101.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-09T14:12:49.641 INFO:teuthology.orchestra.run.smithi005.stdout:(23/131): python3-rgw-18.0.0-5389.g668a86f2.el8 2.5 MB/s | 107 kB 00:00 2023-08-09T14:12:49.671 INFO:teuthology.orchestra.run.smithi101.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-08-09T14:12:49.713 INFO:teuthology.orchestra.run.smithi101.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-09T14:12:49.716 INFO:teuthology.orchestra.run.smithi005.stdout:(24/131): rbd-fuse-18.0.0-5389.g668a86f2.el8.x8 1.2 MB/s | 93 kB 00:00 2023-08-09T14:12:49.747 INFO:teuthology.orchestra.run.smithi101.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-08-09T14:12:49.831 INFO:teuthology.orchestra.run.smithi101.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-08-09T14:12:49.881 INFO:teuthology.orchestra.run.smithi101.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-08-09T14:12:49.923 INFO:teuthology.orchestra.run.smithi101.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-08-09T14:12:50.048 INFO:teuthology.orchestra.run.smithi101.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-08-09T14:12:50.065 INFO:teuthology.orchestra.run.smithi101.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 451 kB/s | 64 kB 00:00 2023-08-09T14:12:50.082 INFO:teuthology.orchestra.run.smithi101.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.7 MB/s | 126 kB 00:00 2023-08-09T14:12:50.083 INFO:teuthology.orchestra.run.smithi005.stdout:(25/131): rbd-mirror-18.0.0-5389.g668a86f2.el8. 9.6 MB/s | 3.5 MB 00:00 2023-08-09T14:12:50.099 INFO:teuthology.orchestra.run.smithi101.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 598 kB/s | 20 kB 00:00 2023-08-09T14:12:50.116 INFO:teuthology.orchestra.run.smithi101.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.0 MB/s | 103 kB 00:00 2023-08-09T14:12:50.134 INFO:teuthology.orchestra.run.smithi005.stdout:(26/131): rbd-nbd-18.0.0-5389.g668a86f2.el8.x86 3.5 MB/s | 179 kB 00:00 2023-08-09T14:12:50.149 INFO:teuthology.orchestra.run.smithi101.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-09T14:12:50.184 INFO:teuthology.orchestra.run.smithi005.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5389.g 463 kB/s | 23 kB 00:00 2023-08-09T14:12:50.259 INFO:teuthology.orchestra.run.smithi005.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5389.g668a86f 1.7 MB/s | 130 kB 00:00 2023-08-09T14:12:50.292 INFO:teuthology.orchestra.run.smithi101.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-08-09T14:12:50.317 INFO:teuthology.orchestra.run.smithi101.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-08-09T14:12:50.359 INFO:teuthology.orchestra.run.smithi101.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-08-09T14:12:50.401 INFO:teuthology.orchestra.run.smithi101.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-09T14:12:50.468 INFO:teuthology.orchestra.run.smithi005.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5389.g668a8 8.4 MB/s | 1.7 MB 00:00 2023-08-09T14:12:50.518 INFO:teuthology.orchestra.run.smithi101.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-08-09T14:12:50.585 INFO:teuthology.orchestra.run.smithi101.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-08-09T14:12:50.627 INFO:teuthology.orchestra.run.smithi101.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-08-09T14:12:50.677 INFO:teuthology.orchestra.run.smithi101.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-08-09T14:12:50.685 INFO:teuthology.orchestra.run.smithi005.stdout:(30/131): ceph-osd-18.0.0-5389.g668a86f2.el8.x8 3.4 MB/s | 18 MB 00:05 2023-08-09T14:12:50.769 INFO:teuthology.orchestra.run.smithi101.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-08-09T14:12:50.785 INFO:teuthology.orchestra.run.smithi005.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5389.g66 2.4 MB/s | 241 kB 00:00 2023-08-09T14:12:50.820 INFO:teuthology.orchestra.run.smithi101.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-08-09T14:12:50.852 INFO:teuthology.orchestra.run.smithi005.stdout:(32/131): ceph-mgr-rook-18.0.0-5389.g668a86f2.e 715 kB/s | 47 kB 00:00 2023-08-09T14:12:50.919 INFO:teuthology.orchestra.run.smithi005.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5389.g6 218 kB/s | 15 kB 00:00 2023-08-09T14:12:51.086 INFO:teuthology.orchestra.run.smithi005.stdout:(34/131): ceph-volume-18.0.0-5389.g668a86f2.el8 1.5 MB/s | 261 kB 00:00 2023-08-09T14:12:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:(35/131): cephadm-18.0.0-5389.g668a86f2.el8.noa 1.5 MB/s | 166 kB 00:00 2023-08-09T14:12:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:(36/131): cephfs-top-18.0.0-5389.g668a86f2.el8. 270 kB/s | 18 kB 00:00 2023-08-09T14:12:51.270 INFO:teuthology.orchestra.run.smithi101.stdout:(130/131): librados2-18.0.0-5389.g668a86f2.el8. 5.7 MB/s | 3.7 MB 00:00 2023-08-09T14:12:51.328 INFO:teuthology.orchestra.run.smithi101.stdout:(131/131): librbd1-18.0.0-5389.g668a86f2.el8.x8 5.6 MB/s | 3.6 MB 00:00 2023-08-09T14:12:51.331 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2023-08-09T14:12:51.331 INFO:teuthology.orchestra.run.smithi101.stdout:Total 19 MB/s | 206 MB 00:11 2023-08-09T14:12:51.537 INFO:teuthology.orchestra.run.smithi005.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.9 MB/s | 7.4 MB 00:01 2023-08-09T14:12:51.712 INFO:teuthology.orchestra.run.smithi005.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2023-08-09T14:12:51.804 INFO:teuthology.orchestra.run.smithi005.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 821 kB/s | 75 kB 00:00 2023-08-09T14:12:51.872 INFO:teuthology.orchestra.run.smithi005.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2023-08-09T14:12:51.972 INFO:teuthology.orchestra.run.smithi005.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 441 kB/s | 44 kB 00:00 2023-08-09T14:12:51.997 INFO:teuthology.orchestra.run.smithi005.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-08-09T14:12:52.172 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2023-08-09T14:12:52.214 INFO:teuthology.orchestra.run.smithi005.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 152 kB/s | 33 kB 00:00 2023-08-09T14:12:52.239 INFO:teuthology.orchestra.run.smithi005.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 693 kB/s | 185 kB 00:00 2023-08-09T14:12:52.291 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2023-08-09T14:12:52.292 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2023-08-09T14:12:52.306 INFO:teuthology.orchestra.run.smithi005.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-08-09T14:12:52.331 INFO:teuthology.orchestra.run.smithi005.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-08-09T14:12:52.407 INFO:teuthology.orchestra.run.smithi005.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-08-09T14:12:52.457 INFO:teuthology.orchestra.run.smithi005.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 648 kB/s | 81 kB 00:00 2023-08-09T14:12:52.507 INFO:teuthology.orchestra.run.smithi005.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-08-09T14:12:52.549 INFO:teuthology.orchestra.run.smithi005.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-08-09T14:12:52.641 INFO:teuthology.orchestra.run.smithi005.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-08-09T14:12:53.125 INFO:teuthology.orchestra.run.smithi005.stdout:(52/131): ceph-test-18.0.0-5389.g668a86f2.el8.x 9.1 MB/s | 48 MB 00:05 2023-08-09T14:12:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 115 kB/s | 59 kB 00:00 2023-08-09T14:12:53.192 INFO:teuthology.orchestra.run.smithi005.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2023-08-09T14:12:53.284 INFO:teuthology.orchestra.run.smithi005.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-08-09T14:12:53.318 INFO:teuthology.orchestra.run.smithi005.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-08-09T14:12:53.385 INFO:teuthology.orchestra.run.smithi005.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2023-08-09T14:12:53.416 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2023-08-09T14:12:53.418 INFO:teuthology.orchestra.run.smithi005.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-08-09T14:12:53.420 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2023-08-09T14:12:53.444 INFO:teuthology.orchestra.run.smithi005.stdout:(59/131): python3-natsort-7.1.1-2.el8.noarch.rp 189 kB/s | 60 kB 00:00 2023-08-09T14:12:53.477 INFO:teuthology.orchestra.run.smithi005.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 696 kB/s | 64 kB 00:00 2023-08-09T14:12:53.511 INFO:teuthology.orchestra.run.smithi005.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-08-09T14:12:53.536 INFO:teuthology.orchestra.run.smithi005.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-08-09T14:12:53.570 INFO:teuthology.orchestra.run.smithi005.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-08-09T14:12:53.603 INFO:teuthology.orchestra.run.smithi005.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-08-09T14:12:53.670 INFO:teuthology.orchestra.run.smithi005.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-08-09T14:12:53.695 INFO:teuthology.orchestra.run.smithi005.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 665 kB/s | 61 kB 00:00 2023-08-09T14:12:53.762 INFO:teuthology.orchestra.run.smithi005.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 929 kB/s | 85 kB 00:00 2023-08-09T14:12:53.779 INFO:teuthology.orchestra.run.smithi005.stdout:(68/131): python3-waitress-1.4.3-1.el8.noarch.r 1.0 MB/s | 255 kB 00:00 2023-08-09T14:12:53.796 INFO:teuthology.orchestra.run.smithi005.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-08-09T14:12:53.822 INFO:teuthology.orchestra.run.smithi005.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-08-09T14:12:53.872 INFO:teuthology.orchestra.run.smithi005.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-08-09T14:12:53.939 INFO:teuthology.orchestra.run.smithi005.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-08-09T14:12:53.956 INFO:teuthology.orchestra.run.smithi005.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 510 kB/s | 43 kB 00:00 2023-08-09T14:12:53.981 INFO:teuthology.orchestra.run.smithi005.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-08-09T14:12:53.998 INFO:teuthology.orchestra.run.smithi005.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-08-09T14:12:54.023 INFO:teuthology.orchestra.run.smithi005.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-09T14:12:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-08-09T14:12:54.074 INFO:teuthology.orchestra.run.smithi005.stdout:(78/131): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-08-09T14:12:54.099 INFO:teuthology.orchestra.run.smithi005.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-08-09T14:12:54.133 INFO:teuthology.orchestra.run.smithi005.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-08-09T14:12:54.150 INFO:teuthology.orchestra.run.smithi005.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2023-08-09T14:12:54.200 INFO:teuthology.orchestra.run.smithi005.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-08-09T14:12:54.233 INFO:teuthology.orchestra.run.smithi005.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-08-09T14:12:54.259 INFO:teuthology.orchestra.run.smithi005.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-08-09T14:12:54.292 INFO:teuthology.orchestra.run.smithi005.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 3.8 MB/s | 559 kB 00:00 2023-08-09T14:12:54.318 INFO:teuthology.orchestra.run.smithi005.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-09T14:12:54.360 INFO:teuthology.orchestra.run.smithi005.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-08-09T14:12:54.385 INFO:teuthology.orchestra.run.smithi005.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.1 MB/s | 72 kB 00:00 2023-08-09T14:12:54.419 INFO:teuthology.orchestra.run.smithi005.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-08-09T14:12:54.477 INFO:teuthology.orchestra.run.smithi005.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 652 kB/s | 60 kB 00:00 2023-08-09T14:12:54.503 INFO:teuthology.orchestra.run.smithi005.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.1 MB/s | 98 kB 00:00 2023-08-09T14:12:54.570 INFO:teuthology.orchestra.run.smithi005.stdout:(92/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2023-08-09T14:12:54.595 INFO:teuthology.orchestra.run.smithi005.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 420 kB/s | 39 kB 00:00 2023-08-09T14:12:54.620 INFO:teuthology.orchestra.run.smithi005.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 405 kB/s | 58 kB 00:00 2023-08-09T14:12:54.654 INFO:teuthology.orchestra.run.smithi005.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-08-09T14:12:54.679 INFO:teuthology.orchestra.run.smithi005.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-08-09T14:12:54.728 INFO:teuthology.orchestra.run.smithi005.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.2 MB/s | 138 kB 00:00 2023-08-09T14:12:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-08-09T14:12:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 495 kB/s | 54 kB 00:00 2023-08-09T14:12:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-08-09T14:12:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-09T14:12:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 579 kB/s | 39 kB 00:00 2023-08-09T14:12:55.007 INFO:teuthology.orchestra.run.smithi005.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 6.1 MB/s | 688 kB 00:00 2023-08-09T14:12:55.048 INFO:teuthology.orchestra.run.smithi005.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 4.5 MB/s | 538 kB 00:00 2023-08-09T14:12:55.073 INFO:teuthology.orchestra.run.smithi005.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-09T14:12:55.098 INFO:teuthology.orchestra.run.smithi005.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-08-09T14:12:55.140 INFO:teuthology.orchestra.run.smithi005.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-08-09T14:12:55.182 INFO:teuthology.orchestra.run.smithi005.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-08-09T14:12:55.233 INFO:teuthology.orchestra.run.smithi005.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-08-09T14:12:55.341 INFO:teuthology.orchestra.run.smithi005.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-08-09T14:12:55.358 INFO:teuthology.orchestra.run.smithi005.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 351 kB/s | 44 kB 00:00 2023-08-09T14:12:55.508 INFO:teuthology.orchestra.run.smithi005.stdout:(112/131): python3-scipy-1.0.0-21.module+el8.5. 16 MB/s | 14 MB 00:00 2023-08-09T14:12:55.567 INFO:teuthology.orchestra.run.smithi005.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 2.1 MB/s | 457 kB 00:00 2023-08-09T14:12:55.592 INFO:teuthology.orchestra.run.smithi005.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.6 MB/s | 225 kB 00:00 2023-08-09T14:12:55.617 INFO:teuthology.orchestra.run.smithi005.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-08-09T14:12:55.642 INFO:teuthology.orchestra.run.smithi005.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-08-09T14:12:55.668 INFO:teuthology.orchestra.run.smithi005.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-08-09T14:12:55.702 INFO:teuthology.orchestra.run.smithi005.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.7 MB/s | 103 kB 00:00 2023-08-09T14:12:55.769 INFO:teuthology.orchestra.run.smithi005.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-08-09T14:12:55.869 INFO:teuthology.orchestra.run.smithi005.stdout:(120/131): python3-numpy-1.14.3-10.el8.x86_64.r 7.1 MB/s | 3.7 MB 00:00 2023-08-09T14:12:55.894 INFO:teuthology.orchestra.run.smithi005.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-08-09T14:12:55.944 INFO:teuthology.orchestra.run.smithi005.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-08-09T14:12:55.995 INFO:teuthology.orchestra.run.smithi005.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-08-09T14:12:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-08-09T14:12:56.179 INFO:teuthology.orchestra.run.smithi005.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-08-09T14:12:56.212 INFO:teuthology.orchestra.run.smithi005.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-08-09T14:12:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-08-09T14:12:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-08-09T14:12:56.431 INFO:teuthology.orchestra.run.smithi005.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 14 MB/s | 798 kB 00:00 2023-08-09T14:12:56.697 INFO:teuthology.orchestra.run.smithi005.stdout:(130/131): librbd1-18.0.0-5389.g668a86f2.el8.x8 8.5 MB/s | 3.6 MB 00:00 2023-08-09T14:12:57.647 INFO:teuthology.orchestra.run.smithi005.stdout:(131/131): librados2-18.0.0-5389.g668a86f2.el8. 2.6 MB/s | 3.7 MB 00:01 2023-08-09T14:12:57.650 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-08-09T14:12:57.650 INFO:teuthology.orchestra.run.smithi005.stdout:Total 14 MB/s | 206 MB 00:15 2023-08-09T14:12:58.355 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2023-08-09T14:12:58.517 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-08-09T14:12:58.604 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-09T14:12:58.649 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-08-09T14:12:58.649 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-08-09T14:12:58.779 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-09T14:12:58.956 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-09T14:12:59.107 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-09T14:12:59.314 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-09T14:12:59.713 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-09T14:12:59.839 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-08-09T14:12:59.843 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-08-09T14:12:59.930 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 5/134 2023-08-09T14:13:00.322 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 5/134 2023-08-09T14:13:00.564 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:13:00.689 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:13:00.872 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:13:00.968 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:13:01.169 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 8/134 2023-08-09T14:13:01.367 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-09T14:13:01.625 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-09T14:13:01.841 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-09T14:13:02.244 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-09T14:13:02.475 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-09T14:13:02.680 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 14/134 2023-08-09T14:13:02.783 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 14/134 2023-08-09T14:13:02.972 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 15/134 2023-08-09T14:13:03.119 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 15/134 2023-08-09T14:13:03.359 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-09T14:13:03.528 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-09T14:13:03.719 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-09T14:13:03.938 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-09T14:13:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-09T14:13:04.230 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-09T14:13:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-09T14:13:05.014 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-09T14:13:05.440 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-08-09T14:13:05.611 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-09T14:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-09T14:13:05.796 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-09T14:13:05.903 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-09T14:13:06.070 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-09T14:13:06.199 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-09T14:13:06.428 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-09T14:13:06.520 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-09T14:13:06.797 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-09T14:13:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-09T14:13:06.985 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-09T14:13:07.028 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 5/134 2023-08-09T14:13:07.223 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-09T14:13:07.386 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-common-2:18.0.0-5389.g668a86f2.el8. 26/134 2023-08-09T14:13:07.480 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 5/134 2023-08-09T14:13:07.549 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 27/134 2023-08-09T14:13:07.687 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:13:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:13:07.819 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_6 28/134 2023-08-09T14:13:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:13:08.029 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-09T14:13:08.112 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:13:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 8/134 2023-08-09T14:13:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-09T14:13:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-09T14:13:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-09T14:13:09.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-09T14:13:09.793 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-09T14:13:10.057 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-09T14:13:10.236 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 14/134 2023-08-09T14:13:10.344 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 14/134 2023-08-09T14:13:10.528 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 15/134 2023-08-09T14:13:10.685 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 15/134 2023-08-09T14:13:10.807 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-09T14:13:10.891 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-09T14:13:11.085 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-09T14:13:11.144 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-09T14:13:11.238 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-09T14:13:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-09T14:13:11.431 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-09T14:13:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-09T14:13:11.644 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-09T14:13:11.658 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-09T14:13:11.865 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-09T14:13:12.039 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-09T14:13:12.227 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 36/134 2023-08-09T14:13:12.297 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-09T14:13:12.393 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_6 37/134 2023-08-09T14:13:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-09T14:13:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-09T14:13:12.704 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-09T14:13:12.862 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-09T14:13:12.931 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-09T14:13:13.120 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-09T14:13:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-09T14:13:13.382 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-09T14:13:13.419 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-09T14:13:13.537 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-09T14:13:13.619 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-09T14:13:13.865 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-09T14:13:14.015 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-09T14:13:14.169 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-09T14:13:14.187 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-09T14:13:14.354 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-09T14:13:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-09T14:13:14.756 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-09T14:13:14.800 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-09T14:13:14.990 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-09T14:13:15.027 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-09T14:13:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-5389.g668a86f2.el8. 26/134 2023-08-09T14:13:15.227 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-09T14:13:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 27/134 2023-08-09T14:13:15.434 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-09T14:13:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_6 28/134 2023-08-09T14:13:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-09T14:13:15.797 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-09T14:13:16.122 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-09T14:13:16.331 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-09T14:13:16.574 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-09T14:13:16.799 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-09T14:13:17.119 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-09T14:13:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-09T14:13:17.578 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-09T14:13:17.700 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-09T14:13:17.782 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-09T14:13:17.952 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-09T14:13:18.139 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-09T14:13:18.437 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-09T14:13:18.716 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-09T14:13:18.834 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-09T14:13:18.966 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-09T14:13:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-09T14:13:19.212 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-09T14:13:19.377 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-09T14:13:19.451 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-09T14:13:19.580 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-09T14:13:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-09T14:13:19.846 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-09T14:13:19.891 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-09T14:13:20.051 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-09T14:13:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-09T14:13:20.240 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-09T14:13:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 36/134 2023-08-09T14:13:20.389 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-09T14:13:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_6 37/134 2023-08-09T14:13:20.562 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-09T14:13:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-09T14:13:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-09T14:13:20.764 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-09T14:13:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-09T14:13:20.972 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-09T14:13:21.139 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-09T14:13:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-09T14:13:21.276 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-09T14:13:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-09T14:13:21.492 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-09T14:13:21.614 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-09T14:13:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-09T14:13:21.784 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-09T14:13:21.864 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-09T14:13:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-09T14:13:22.118 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-09T14:13:22.167 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-09T14:13:22.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-09T14:13:22.427 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-09T14:13:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-09T14:13:22.585 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-09T14:13:22.666 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-09T14:13:22.793 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-09T14:13:22.879 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-09T14:13:23.006 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-09T14:13:23.229 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-09T14:13:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-09T14:13:23.772 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-09T14:13:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-09T14:13:24.080 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-09T14:13:24.155 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-09T14:13:24.314 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-09T14:13:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-09T14:13:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-09T14:13:24.701 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-09T14:13:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-09T14:13:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-09T14:13:25.189 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-09T14:13:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-09T14:13:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-09T14:13:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-09T14:13:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-09T14:13:26.056 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-09T14:13:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-09T14:13:26.235 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 92/134 2023-08-09T14:13:26.305 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 92/134 2023-08-09T14:13:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-09T14:13:26.494 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 93/134 2023-08-09T14:13:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-09T14:13:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-09T14:13:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-09T14:13:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-09T14:13:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-09T14:13:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-09T14:13:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-09T14:13:28.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-09T14:13:28.531 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-09T14:13:28.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-09T14:13:28.865 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-09T14:13:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-09T14:13:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-09T14:13:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-09T14:13:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-09T14:13:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-09T14:13:30.076 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-09T14:13:30.277 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-09T14:13:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-09T14:13:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-09T14:13:30.919 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-09T14:13:31.222 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 95/134 2023-08-09T14:13:31.307 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 95/134 2023-08-09T14:13:31.330 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-09T14:13:31.501 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 96/134 2023-08-09T14:13:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-09T14:13:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-09T14:13:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-09T14:13:33.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-09T14:13:33.740 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-09T14:13:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-09T14:13:34.822 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-09T14:13:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 92/134 2023-08-09T14:13:35.094 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 92/134 2023-08-09T14:13:35.291 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 93/134 2023-08-09T14:13:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 94/134 2023-08-09T14:13:40.539 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 95/134 2023-08-09T14:13:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 95/134 2023-08-09T14:13:40.757 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 96/134 2023-08-09T14:13:50.485 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 96/134 2023-08-09T14:13:50.485 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /sys 2023-08-09T14:13:50.485 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /proc 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /run 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /mnt 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /var/tmp 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /home 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /tmp 2023-08-09T14:13:50.486 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2023-08-09T14:13:50.487 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:13:50.874 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 97/134 2023-08-09T14:13:52.459 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 97/134 2023-08-09T14:13:52.602 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 98/134 2023-08-09T14:13:52.820 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 98/134 2023-08-09T14:13:52.965 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 99/134 2023-08-09T14:13:53.430 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 99/134 2023-08-09T14:13:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 100/134 2023-08-09T14:13:53.699 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 100/134 2023-08-09T14:13:55.385 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 101/134 2023-08-09T14:13:55.630 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 101/134 2023-08-09T14:13:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 102/134 2023-08-09T14:13:55.955 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 103/134 2023-08-09T14:13:56.148 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 104/134 2023-08-09T14:13:56.367 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 104/134 2023-08-09T14:13:56.693 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 105/134 2023-08-09T14:13:57.651 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 105/134 2023-08-09T14:13:57.831 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 106/134 2023-08-09T14:13:57.922 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 106/134 2023-08-09T14:13:58.289 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 107/134 2023-08-09T14:13:58.493 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 108/134 2023-08-09T14:13:58.528 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 108/134 2023-08-09T14:13:58.714 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 109/134 2023-08-09T14:13:58.726 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 109/134 2023-08-09T14:14:00.002 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 110/134 2023-08-09T14:14:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 111/134 2023-08-09T14:14:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 111/134 2023-08-09T14:14:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 96/134 2023-08-09T14:14:00.372 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-08-09T14:14:00.372 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-08-09T14:14:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:00.406 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 112/134 2023-08-09T14:14:00.449 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5389.g668a8 112/134 2023-08-09T14:14:00.623 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 113/134 2023-08-09T14:14:00.763 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 97/134 2023-08-09T14:14:00.985 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 113/134 2023-08-09T14:14:01.156 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 114/134 2023-08-09T14:14:02.450 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 97/134 2023-08-09T14:14:02.652 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 98/134 2023-08-09T14:14:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 98/134 2023-08-09T14:14:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 99/134 2023-08-09T14:14:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 99/134 2023-08-09T14:14:03.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 100/134 2023-08-09T14:14:03.805 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 100/134 2023-08-09T14:14:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 101/134 2023-08-09T14:14:05.689 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 114/134 2023-08-09T14:14:05.846 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 101/134 2023-08-09T14:14:05.985 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 102/134 2023-08-09T14:14:06.172 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 103/134 2023-08-09T14:14:06.369 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 104/134 2023-08-09T14:14:06.556 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 115/134 2023-08-09T14:14:06.596 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 104/134 2023-08-09T14:14:06.912 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-09T14:14:06.918 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 105/134 2023-08-09T14:14:07.102 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 117/134 2023-08-09T14:14:07.335 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-09T14:14:07.488 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-09T14:14:07.705 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-09T14:14:07.942 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 105/134 2023-08-09T14:14:07.942 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-09T14:14:08.094 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 106/134 2023-08-09T14:14:08.126 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_ 121/134 2023-08-09T14:14:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 106/134 2023-08-09T14:14:08.298 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-09T14:14:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 107/134 2023-08-09T14:14:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 108/134 2023-08-09T14:14:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 108/134 2023-08-09T14:14:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 109/134 2023-08-09T14:14:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 109/134 2023-08-09T14:14:10.402 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 110/134 2023-08-09T14:14:10.426 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 111/134 2023-08-09T14:14:10.663 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:10.680 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:10.692 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 111/134 2023-08-09T14:14:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 112/134 2023-08-09T14:14:10.846 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 124/134 2023-08-09T14:14:10.889 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5389.g668a8 112/134 2023-08-09T14:14:11.036 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 113/134 2023-08-09T14:14:11.171 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 125/134 2023-08-09T14:14:11.421 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 126/134 2023-08-09T14:14:11.431 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 113/134 2023-08-09T14:14:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 114/134 2023-08-09T14:14:11.734 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-09T14:14:11.921 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-09T14:14:12.001 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-09T14:14:12.204 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-09T14:14:12.217 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-09T14:14:12.379 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-09T14:14:12.388 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-09T14:14:12.548 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-09T14:14:12.548 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:12.724 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:12.724 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-09T14:14:12.952 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-09T14:14:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:13.654 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 1/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 2/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 3/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 4/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 5/134 2023-08-09T14:14:13.655 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 8/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 9/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 10/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 11/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 12/134 2023-08-09T14:14:13.656 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 13/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_ 14/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 15/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 16/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_6 17/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 18/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 19/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 20/134 2023-08-09T14:14:13.657 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-common-2:18.0.0-5389.g668a86f2.el8. 21/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_6 22/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 23/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 24/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 25/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 26/134 2023-08-09T14:14:13.658 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 27/134 2023-08-09T14:14:13.659 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 28/134 2023-08-09T14:14:13.659 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 29/134 2023-08-09T14:14:13.659 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 30/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 31/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 32/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 33/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 34/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 35/134 2023-08-09T14:14:13.660 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 36/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 37/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 38/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-09T14:14:13.661 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-09T14:14:13.662 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-09T14:14:13.663 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-09T14:14:13.664 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-09T14:14:13.664 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-09T14:14:13.664 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-09T14:14:13.664 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-09T14:14:13.665 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-09T14:14:13.665 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-09T14:14:13.665 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-09T14:14:13.665 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-09T14:14:13.666 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-09T14:14:13.666 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-09T14:14:13.666 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-09T14:14:13.667 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-09T14:14:13.667 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-09T14:14:13.667 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-09T14:14:13.667 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-09T14:14:13.668 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-09T14:14:13.668 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-09T14:14:13.668 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-09T14:14:13.669 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-09T14:14:13.669 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-09T14:14:13.670 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-09T14:14:13.670 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-09T14:14:13.670 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-09T14:14:13.671 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-09T14:14:13.671 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-09T14:14:13.671 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-09T14:14:13.671 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-09T14:14:13.672 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-09T14:14:13.672 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-09T14:14:13.672 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-09T14:14:13.672 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-09T14:14:13.672 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-09T14:14:13.673 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-09T14:14:13.673 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-09T14:14:13.673 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-09T14:14:13.674 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-09T14:14:13.675 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-09T14:14:13.676 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-09T14:14:13.677 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-09T14:14:13.678 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 129/134 2023-08-09T14:14:13.679 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-09T14:14:13.679 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 131/134 2023-08-09T14:14:13.679 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:13.679 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-09T14:14:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 114/134 2023-08-09T14:14:16.462 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:16.462 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:48 ago on Wed 09 Aug 2023 02:12:28 PM UTC. 2023-08-09T14:14:17.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 115/134 2023-08-09T14:14:17.705 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-09T14:14:17.907 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 117/134 2023-08-09T14:14:18.169 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-09T14:14:18.343 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-09T14:14:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-09T14:14:18.789 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-09T14:14:18.964 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_ 121/134 2023-08-09T14:14:19.144 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-09T14:14:19.244 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2023-08-09T14:14:19.461 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:19.462 INFO:teuthology.orchestra.run.smithi101.stdout:Upgraded: 2023-08-09T14:14:19.462 INFO:teuthology.orchestra.run.smithi101.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-09T14:14:19.462 INFO:teuthology.orchestra.run.smithi101.stdout: librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.463 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.463 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2023-08-09T14:14:19.463 INFO:teuthology.orchestra.run.smithi101.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-09T14:14:19.463 INFO:teuthology.orchestra.run.smithi101.stdout: automake-1.16.1-7.el8.noarch 2023-08-09T14:14:19.464 INFO:teuthology.orchestra.run.smithi101.stdout: bison-3.0.4-10.el8.x86_64 2023-08-09T14:14:19.464 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.464 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.465 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.465 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.465 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.465 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.466 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.466 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.466 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.466 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.467 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.467 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.467 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.467 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.468 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: flex-2.6.1-9.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: jq-1.6-3.el8.x86_64 2023-08-09T14:14:19.469 INFO:teuthology.orchestra.run.smithi101.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-09T14:14:19.470 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: libpq-13.5-1.el8.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.471 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-09T14:14:19.472 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-09T14:14:19.473 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:19.474 INFO:teuthology.orchestra.run.smithi101.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-09T14:14:19.475 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-09T14:14:19.475 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-09T14:14:19.475 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-09T14:14:19.475 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-09T14:14:19.476 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-09T14:14:19.477 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-09T14:14:19.478 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-09T14:14:19.479 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend-2.6-1.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-09T14:14:19.480 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-09T14:14:19.481 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-09T14:14:19.482 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-09T14:14:19.483 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-09T14:14:19.484 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-09T14:14:19.484 INFO:teuthology.orchestra.run.smithi101.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-09T14:14:19.484 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:19.484 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2023-08-09T14:14:19.651 DEBUG:teuthology.parallel:result is None 2023-08-09T14:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:21.767 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:21.786 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-09T14:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 124/134 2023-08-09T14:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 125/134 2023-08-09T14:14:22.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 126/134 2023-08-09T14:14:22.946 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-09T14:14:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-09T14:14:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-09T14:14:23.475 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-09T14:14:23.489 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-09T14:14:23.659 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-09T14:14:23.894 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-09T14:14:23.895 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-09T14:14:23.895 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:24.071 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:24.071 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-09T14:14:24.369 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-09T14:14:24.566 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 1/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 2/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 3/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 4/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 5/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 6/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 7/134 2023-08-09T14:14:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 8/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 9/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 10/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 11/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 12/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 13/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_ 14/134 2023-08-09T14:14:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 15/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 16/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_6 17/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86 18/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 19/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 20/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-5389.g668a86f2.el8. 21/134 2023-08-09T14:14:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_6 22/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 23/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 24/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 25/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 26/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 27/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 28/134 2023-08-09T14:14:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 29/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noa 30/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.n 31/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 32/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 33/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 34/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 35/134 2023-08-09T14:14:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 36/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 37/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 38/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-09T14:14:25.129 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-09T14:14:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-09T14:14:25.131 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-09T14:14:25.132 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-09T14:14:25.133 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-09T14:14:25.133 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-09T14:14:25.133 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-09T14:14:25.133 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-09T14:14:25.134 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-09T14:14:25.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-09T14:14:25.136 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-09T14:14:25.137 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-09T14:14:25.138 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-09T14:14:25.139 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-09T14:14:25.140 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-09T14:14:25.141 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 129/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-09T14:14:25.142 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 131/134 2023-08-09T14:14:25.143 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-09T14:14:25.143 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-09T14:14:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-09T14:14:28.032 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:59 ago on Wed 09 Aug 2023 02:12:29 PM UTC. 2023-08-09T14:14:30.786 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-08-09T14:14:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:31.037 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-08-09T14:14:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-09T14:14:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.037 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-7.el8.noarch 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.0.0-5389.g668a86f2.el8.noarch 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-09T14:14:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-3.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.5-1.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-09T14:14:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-09T14:14:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-09T14:14:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-09T14:14:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-09T14:14:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-09T14:14:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-09T14:14:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-09T14:14:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-5389.g668a86f2.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-09T14:14:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-09T14:14:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-08-09T14:14:31.279 DEBUG:teuthology.parallel:result is None 2023-08-09T14:14:31.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T14:14:31.432 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-09T14:14:31.457 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-5389.g668a86f2.el8 2023-08-09T14:14:31.457 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5389.g668a86f2.el8 2023-08-09T14:14:31.458 INFO:teuthology.task.install:The correct ceph version 18.0.0-5389.g668a86f2 is installed. 2023-08-09T14:14:31.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T14:14:31.852 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-09T14:14:31.881 INFO:teuthology.orchestra.run.smithi101.stdout:18.0.0-5389.g668a86f2.el8 2023-08-09T14:14:31.882 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5389.g668a86f2.el8 2023-08-09T14:14:31.882 INFO:teuthology.task.install:The correct ceph version 18.0.0-5389.g668a86f2 is installed. 2023-08-09T14:14:31.883 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-09T14:14:31.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:31.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-09T14:14:31.930 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:31.930 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-09T14:14:31.975 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-09T14:14:31.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:31.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-08-09T14:14:32.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-09T14:14:32.075 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:32.075 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/daemon-helper 2023-08-09T14:14:32.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-09T14:14:32.174 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-09T14:14:32.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:32.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-09T14:14:32.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-09T14:14:32.273 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:32.273 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-09T14:14:32.301 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-09T14:14:32.367 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-09T14:14:32.368 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:32.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-08-09T14:14:32.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-09T14:14:32.465 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:32.466 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/stdin-killer 2023-08-09T14:14:32.493 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-09T14:14:32.561 INFO:teuthology.run_tasks:Running task ceph... 2023-08-09T14:14:32.639 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-09T14:14:32.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-08-09T14:14:32.642 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 777 /var/log/ceph 2023-08-09T14:14:32.669 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-09T14:14:32.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-09T14:14:32.712 DEBUG:teuthology.orchestra.run.smithi101:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-09T14:14:32.748 INFO:tasks.ceph:Creating extra log directories... 2023-08-09T14:14:32.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-09T14:14:32.780 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-09T14:14:32.820 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-09T14:14:32.821 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-09T14:14:32.821 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-09T14:14:32.821 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:32.822 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-09T14:14:32.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-09T14:14:32.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-09T14:14:33.022 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:33.022 DEBUG:teuthology.orchestra.run.smithi101:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-09T14:14:33.040 DEBUG:teuthology.orchestra.run.smithi101:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-09T14:14:33.317 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-09T14:14:33.352 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-09T14:14:33.352 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-09T14:14:33.353 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364168', 'branch': 'wip-vshankar-testing-20230809.035933', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7364168', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230809.035933'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230809.035933', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8976, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'sleep_before_teardown': 0, 'subset': '486/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230809.035933', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi101.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '7fda95956ac10132c9b74016ba832db907df09fa', 'timestamp': '2023-08-09_05:46:29', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-09T14:14:33.353 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-09T14:14:33.355 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-09T14:14:33.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-08-09T14:14:33.413 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/run/ceph 2023-08-09T14:14:33.476 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:33.476 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-08-09T14:14:33.496 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-09T14:14:33.497 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-08-09T14:14:33.553 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 388681 Links: 1 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-08-09 14:14:24.803146907 +0000 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-08-09 14:11:42.382714225 +0000 2023-08-09T14:14:33.554 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-08-09 14:11:42.382714225 +0000 2023-08-09T14:14:33.555 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-08-09T14:14:33.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-09T14:14:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-08-09T14:14:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-08-09T14:14:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000116985 s, 4.4 MB/s 2023-08-09T14:14:33.621 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-09T14:14:33.679 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-08-09T14:14:33.736 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-09T14:14:33.736 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:33.736 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 384448 Links: 1 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-08-09 14:14:24.803146907 +0000 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-08-09 14:11:42.914703423 +0000 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-08-09 14:11:42.914703423 +0000 2023-08-09T14:14:33.737 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-08-09T14:14:33.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-09T14:14:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-08-09T14:14:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-08-09T14:14:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000105272 s, 4.9 MB/s 2023-08-09T14:14:33.803 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-09T14:14:33.861 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-08-09T14:14:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-09T14:14:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:33.921 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 383990 Links: 1 2023-08-09T14:14:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-08-09 14:14:24.803146907 +0000 2023-08-09T14:14:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-08-09 14:11:43.459692356 +0000 2023-08-09T14:14:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-08-09 14:11:43.459692356 +0000 2023-08-09T14:14:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-08-09T14:14:33.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-09T14:14:33.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-08-09T14:14:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-08-09T14:14:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000102671 s, 5.0 MB/s 2023-08-09T14:14:33.990 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-09T14:14:34.056 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-08-09T14:14:34.119 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-09T14:14:34.120 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:34.120 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 385631 Links: 1 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-08-09 14:14:24.803146907 +0000 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-08-09 14:11:43.970681980 +0000 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-08-09 14:11:43.970681980 +0000 2023-08-09T14:14:34.121 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-08-09T14:14:34.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-09T14:14:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-08-09T14:14:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-08-09T14:14:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00010694 s, 4.8 MB/s 2023-08-09T14:14:34.187 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-09T14:14:34.246 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:34.246 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:34.247 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/scratch_devs of=/dev/stdout 2023-08-09T14:14:34.269 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-09T14:14:34.271 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_1 2023-08-09T14:14:34.340 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-09T14:14:34.341 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:34.341 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 383981 Links: 1 2023-08-09T14:14:34.341 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:34.341 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:34.341 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-09 14:14:13.353722484 +0000 2023-08-09T14:14:34.342 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-09 14:11:26.049870749 +0000 2023-08-09T14:14:34.342 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-09 14:11:26.049870749 +0000 2023-08-09T14:14:34.342 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-09T14:14:34.342 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-09T14:14:34.412 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-09T14:14:34.413 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-09T14:14:34.413 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000268253 s, 1.9 MB/s 2023-08-09T14:14:34.414 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-09T14:14:34.473 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_2 2023-08-09T14:14:34.540 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-09T14:14:34.540 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:34.540 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 382406 Links: 1 2023-08-09T14:14:34.540 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:34.541 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:34.541 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-09 14:14:13.353722484 +0000 2023-08-09T14:14:34.541 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-09 14:11:26.562858727 +0000 2023-08-09T14:14:34.541 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-09 14:11:26.562858727 +0000 2023-08-09T14:14:34.541 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-09T14:14:34.542 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-09T14:14:34.608 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-09T14:14:34.608 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-09T14:14:34.608 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000225895 s, 2.3 MB/s 2023-08-09T14:14:34.609 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-09T14:14:34.668 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_3 2023-08-09T14:14:34.730 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-09T14:14:34.730 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 385520 Links: 1 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-09 14:14:13.353722484 +0000 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-09 14:11:27.091846330 +0000 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-09 14:11:27.091846330 +0000 2023-08-09T14:14:34.731 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-09T14:14:34.732 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-09T14:14:34.797 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-09T14:14:34.798 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-09T14:14:34.798 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000210323 s, 2.4 MB/s 2023-08-09T14:14:34.800 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-09T14:14:34.865 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_4 2023-08-09T14:14:34.928 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-09T14:14:34.928 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T14:14:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 386318 Links: 1 2023-08-09T14:14:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T14:14:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T14:14:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-09 14:14:13.354722461 +0000 2023-08-09T14:14:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-09 14:11:27.606834260 +0000 2023-08-09T14:14:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-09 14:11:27.606834260 +0000 2023-08-09T14:14:34.929 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-09T14:14:34.929 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-09T14:14:34.997 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-09T14:14:34.998 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-09T14:14:34.998 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000325255 s, 1.6 MB/s 2023-08-09T14:14:34.998 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-09T14:14:35.062 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:35.063 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-09T14:14:35.063 INFO:tasks.ceph:Generating config... 2023-08-09T14:14:35.065 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-09T14:14:35.065 INFO:tasks.ceph:[client] debug client = 20 2023-08-09T14:14:35.065 INFO:tasks.ceph:[client] debug ms = 1 2023-08-09T14:14:35.065 INFO:tasks.ceph:[client] pid file = 2023-08-09T14:14:35.065 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-09T14:14:35.066 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-09T14:14:35.066 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-09T14:14:35.066 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-09T14:14:35.066 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-09T14:14:35.066 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-09T14:14:35.067 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-09T14:14:35.067 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-09T14:14:35.068 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-09T14:14:35.068 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-09T14:14:35.068 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-09T14:14:35.068 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-09T14:14:35.068 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-09T14:14:35.069 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-09T14:14:35.069 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-09T14:14:35.069 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-09T14:14:35.069 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-09T14:14:35.069 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-09T14:14:35.070 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-09T14:14:35.070 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-09T14:14:35.070 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-09T14:14:35.071 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-09T14:14:35.071 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-09T14:14:35.071 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-09T14:14:35.072 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-09T14:14:35.072 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-09T14:14:35.072 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-09T14:14:35.072 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-09T14:14:35.073 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-09T14:14:35.073 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-09T14:14:35.073 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-09T14:14:35.073 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-09T14:14:35.074 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-09T14:14:35.074 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-09T14:14:35.074 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-09T14:14:35.074 INFO:tasks.ceph:Setting up mon.a... 2023-08-09T14:14:35.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-09T14:14:35.235 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-08-09T14:14:35.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-09T14:14:35.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T14:14:35.321 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.101'), ('mon.c', '[v2:172.21.15.101:3301,v1:172.21.15.101:6790]')] 2023-08-09T14:14:35.322 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.101,[v2:172.21.15.101:3301,v1:172.21.15.101:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-09T14:14:35.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:35.323 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-09T14:14:35.383 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.101 --addv c '[v2:172.21.15.101:3301,v1:172.21.15.101:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 59d7238d-6ce2-4e7c-9329-64c716150f65 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 59d7238d-6ce2-4e7c-9329-64c716150f65 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-08-09T14:14:35.479622+0000 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-08-09T14:14:35.479622+0000 2023-08-09T14:14:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-08-09T14:14:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-08-09T14:14:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-08-09T14:14:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] mon.b 2023-08-09T14:14:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] mon.c 2023-08-09T14:14:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-09T14:14:35.483 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-09T14:14:35.503 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 59d7238d-6ce2-4e7c-9329-64c716150f65... 2023-08-09T14:14:35.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-09T14:14:35.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-09T14:14:35.593 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-08-09T14:14:35.594 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-08-09T14:14:35.594 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-09T14:14:35.595 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-08-09T14:14:35.595 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.595 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-08-09T14:14:35.595 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.596 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-08-09T14:14:35.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.596 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-08-09T14:14:35.596 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-09T14:14:35.597 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.598 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-08-09T14:14:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-08-09T14:14:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-08-09T14:14:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-08-09T14:14:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-08-09T14:14:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-09T14:14:35.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-08-09T14:14:35.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.101,[v2:172.21.15.101:3301,v1:172.21.15.101:6790]" 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 59d7238d-6ce2-4e7c-9329-64c716150f65 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-08-09T14:14:35.602 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-08-09T14:14:35.603 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-08-09T14:14:35.604 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.604 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-08-09T14:14:35.604 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-08-09T14:14:35.604 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-08-09T14:14:35.604 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-08-09T14:14:35.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-08-09T14:14:35.606 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-08-09T14:14:35.607 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2023-08-09T14:14:35.608 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2023-08-09T14:14:35.608 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-08-09T14:14:35.608 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-08-09T14:14:35.608 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2023-08-09T14:14:35.608 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-08-09T14:14:35.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-08-09T14:14:35.610 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-08-09T14:14:35.611 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-08-09T14:14:35.611 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-08-09T14:14:35.611 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-08-09T14:14:35.611 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-08-09T14:14:35.612 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-08-09T14:14:35.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.614 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-08-09T14:14:35.615 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-08-09T14:14:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-08-09T14:14:35.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2023-08-09T14:14:35.618 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2023-08-09T14:14:35.619 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2023-08-09T14:14:35.619 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2023-08-09T14:14:35.619 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-08-09T14:14:35.619 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-08-09T14:14:35.619 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-08-09T14:14:35.621 INFO:teuthology.orchestra.run.smithi101.stdout:[global] 2023-08-09T14:14:35.621 INFO:teuthology.orchestra.run.smithi101.stdout: chdir = "" 2023-08-09T14:14:35.621 INFO:teuthology.orchestra.run.smithi101.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: auth supported = cephx 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: filestore xattr use omap = true 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: mon clock drift allowed = 1.000 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.622 INFO:teuthology.orchestra.run.smithi101.stdout: osd crush chooseleaf type = 0 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: auth debug = true 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on old message = true 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on bug = true 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-09T14:14:35.623 INFO:teuthology.orchestra.run.smithi101.stdout: mon pg warn max object skew = 0 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: # disable pg_autoscaler by default for new pools 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default size = 2 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.624 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow primary affinity = true 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow pg remap = true 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on legacy crush tunables = false 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on crush straw calc version zero = false 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on no sortbitwise = false 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on osd down out interval zero = false 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on too few osds = false 2023-08-09T14:14:35.625 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: mon_allow_pool_size_one = true 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: osd default data pool replay window = 5 2023-08-09T14:14:35.626 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: mon allow pool delete = true 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: mon cluster log file level = debug 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: debug asserts on shutdown = true 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: mon health detail to clog = false 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: mon host = "172.21.15.5,172.21.15.101,[v2:172.21.15.101:3301,v1:172.21.15.101:6790]" 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on skipped message = False 2023-08-09T14:14:35.627 INFO:teuthology.orchestra.run.smithi101.stdout: fsid = 59d7238d-6ce2-4e7c-9329-64c716150f65 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout:[osd] 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: osd journal size = 100 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub load threshold = 5.0 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub max interval = 600 2023-08-09T14:14:35.628 INFO:teuthology.orchestra.run.smithi101.stdout: osd mclock profile = high_recovery_ops 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: osd recover clone overlap = true 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: osd recovery max chunk = 1048576 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug shutdown = true 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug op order = true 2023-08-09T14:14:35.629 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug verify stray on activate = true 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: osd open classes on start = true 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug pg log writeout = true 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: osd deep scrub update digest min age = 30 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: osd map max advance = 10 2023-08-09T14:14:35.630 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: journal zero on create = true 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: filestore ondisk finisher threads = 3 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: filestore apply finisher threads = 3 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: bdev debug aio = true 2023-08-09T14:14:35.631 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug misdirected ops = true 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: bdev async discard = True 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: bdev enable discard = True 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore allocator = bitmap 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore block size = 96636764160 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore fsck on mount = True 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluefs = 1/20 2023-08-09T14:14:35.632 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluestore = 1/20 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: debug osd = 20 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: debug rocksdb = 4/10 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd backfillfull_ratio = 0.85 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd full ratio = 0.9 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd nearfull ratio = 0.8 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: osd failsafe full ratio = 0.95 2023-08-09T14:14:35.633 INFO:teuthology.orchestra.run.smithi101.stdout: osd objectstore = bluestore 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: osd op complaint time = 180 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr] 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: debug mgr = 20 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2023-08-09T14:14:35.634 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: mgr/telemetry/nag = false 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout:[mon] 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: debug paxos = 20 2023-08-09T14:14:35.635 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon data avail warn = 5 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon mgr mkfs grace = 240 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd reporter subtree level = osd 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd prime pg temp = true 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2023-08-09T14:14:35.636 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: auth mon ticket ttl = 660 # 11m 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: auth service ticket ttl = 240 # 4m 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: # don't complain about insecure global_id in the test suite 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-09T14:14:35.637 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: # 1m isn't quite enough 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: mon_down_mkfs_grace = 2m 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_filestore_osds = false 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: mon op complaint time = 120 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout:[client] 2023-08-09T14:14:35.638 INFO:teuthology.orchestra.run.smithi101.stdout: rgw cache enabled = true 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable ops log = true 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable usage log = true 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: client mount timeout = 600 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: debug client = 20 2023-08-09T14:14:35.639 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout: pid file = "" 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout: rados mon op timeout = 900 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout: rados osd op timeout = 900 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.a] 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.b] 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.c] 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.a] 2023-08-09T14:14:35.640 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.c] 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.b] 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.d] 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout:[mds] 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout: debug mds = 20 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout: debug mds balancer = 20 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout: mds debug frag = True 2023-08-09T14:14:35.641 INFO:teuthology.orchestra.run.smithi101.stdout: mds debug scatterstat = True 2023-08-09T14:14:35.642 INFO:teuthology.orchestra.run.smithi101.stdout: mds op complaint time = 180 2023-08-09T14:14:35.642 INFO:teuthology.orchestra.run.smithi101.stdout: mds verify scatter = True 2023-08-09T14:14:35.642 INFO:teuthology.orchestra.run.smithi101.stdout: osd op complaint time = 180 2023-08-09T14:14:35.642 INFO:teuthology.orchestra.run.smithi101.stdout: rados mon op timeout = 900 2023-08-09T14:14:35.642 INFO:teuthology.orchestra.run.smithi101.stdout: rados osd op timeout = 900 2023-08-09T14:14:35.642 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-09T14:14:35.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-09T14:14:35.724 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-09T14:14:35.724 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:35.724 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-09T14:14:35.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:35.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-09T14:14:35.802 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:14:35.803 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:35.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-09T14:14:35.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T14:14:35.883 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:14:35.884 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:35.941 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:14:35.942 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:35.942 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-09T14:14:35.943 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T14:14:35.984 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:14:35.985 DEBUG:teuthology.orchestra.run.smithi101:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:36.042 INFO:tasks.ceph:Setting up mon nodes... 2023-08-09T14:14:36.043 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-09T14:14:36.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-09T14:14:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-09T14:14:36.101 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-09T14:14:36.185 INFO:teuthology.orchestra.run.smithi101.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-09T14:14:36.188 INFO:tasks.ceph:Setting up mds nodes... 2023-08-09T14:14:36.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-09T14:14:36.244 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-09T14:14:36.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-09T14:14:36.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-09T14:14:36.369 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-09T14:14:36.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-09T14:14:36.399 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-09T14:14:36.455 INFO:teuthology.orchestra.run.smithi101.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-09T14:14:36.458 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-09T14:14:36.484 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-09T14:14:36.577 INFO:teuthology.orchestra.run.smithi101.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-09T14:14:36.579 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-09T14:14:36.605 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-09T14:14:36.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-09T14:14:36.651 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-09T14:14:36.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-09T14:14:36.708 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-09T14:14:36.726 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-09T14:14:36.769 INFO:teuthology.orchestra.run.smithi101.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-09T14:14:36.782 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-09T14:14:36.864 INFO:teuthology.orchestra.run.smithi101.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-09T14:14:36.876 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-09T14:14:36.877 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-09T14:14:36.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-09T14:14:36.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:36.905 INFO:tasks.ceph:role: osd.0 2023-08-09T14:14:36.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:14:36.905 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:36.972 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:36.973 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:36.973 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:36.973 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:36.973 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:36.994 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-08-09T14:14:36.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-08-09T14:14:36.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-09T14:14:37.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-09T14:14:37.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-09T14:14:37.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:37.217 INFO:tasks.ceph:role: osd.1 2023-08-09T14:14:37.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:14:37.218 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-09T14:14:37.283 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:37.284 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:37.284 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:37.284 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:37.284 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:37.284 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:37.285 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:37.285 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:37.285 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:37.285 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:37.306 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-08-09T14:14:37.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-08-09T14:14:37.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-09T14:14:37.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-09T14:14:37.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-09T14:14:37.526 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:37.526 INFO:tasks.ceph:role: osd.2 2023-08-09T14:14:37.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:14:37.528 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-09T14:14:37.593 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:37.595 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:37.615 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-08-09T14:14:37.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-08-09T14:14:37.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-09T14:14:37.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-09T14:14:37.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-09T14:14:37.836 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:37.836 INFO:tasks.ceph:role: osd.3 2023-08-09T14:14:37.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:14:37.837 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-09T14:14:37.903 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:37.903 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:37.903 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:37.904 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:37.925 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-08-09T14:14:37.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-08-09T14:14:37.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-09T14:14:38.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-09T14:14:38.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.195+0000 7f36bb964640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-09T14:14:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.195+0000 7f36bb964640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-09T14:14:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.196+0000 7f36bb964640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-09T14:14:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.196+0000 7f36bb964640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-09T14:14:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.196+0000 7f36bb964640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-09T14:14:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:38.196+0000 7f36bb964640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-09T14:14:41.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-09T14:14:41.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-09T14:14:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-09T14:14:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-09T14:14:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-09T14:14:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-09T14:14:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:41.190+0000 7fd1923b4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-09T14:14:44.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-09T14:14:44.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.178+0000 7f3c97234640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-09T14:14:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.178+0000 7f3c97234640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-09T14:14:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.178+0000 7f3c97234640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-09T14:14:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.178+0000 7f3c97234640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-09T14:14:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.178+0000 7f3c97234640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-09T14:14:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:44.179+0000 7f3c97234640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-09T14:14:47.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-09T14:14:47.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-09T14:14:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-09T14:14:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-09T14:14:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-09T14:14:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-09T14:14:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:14:47.199+0000 7f4284f07640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-09T14:14:50.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-09T14:14:50.100 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-09T14:14:50.134 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:50.134 INFO:tasks.ceph:role: osd.4 2023-08-09T14:14:50.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:14:50.135 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-09T14:14:50.211 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:50.212 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:50.213 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:50.213 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:50.639 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2023-08-09T14:14:50.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2023-08-09T14:14:50.642 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-09T14:14:50.802 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-09T14:14:50.837 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-09T14:14:50.905 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:50.905 INFO:tasks.ceph:role: osd.5 2023-08-09T14:14:50.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:14:50.906 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-09T14:14:50.979 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:50.980 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:50.980 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:50.980 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:50.980 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:50.980 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:50.981 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:50.981 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:50.981 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:50.981 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:51.402 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2023-08-09T14:14:51.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2023-08-09T14:14:51.404 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-09T14:14:51.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-09T14:14:51.546 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-09T14:14:51.613 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:51.613 INFO:tasks.ceph:role: osd.6 2023-08-09T14:14:51.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:14:51.614 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-09T14:14:51.687 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:51.687 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:51.688 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:51.689 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:52.139 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2023-08-09T14:14:52.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2023-08-09T14:14:52.141 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-09T14:14:52.290 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-09T14:14:52.326 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-09T14:14:52.394 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T14:14:52.395 INFO:tasks.ceph:role: osd.7 2023-08-09T14:14:52.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:14:52.395 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-09T14:14:52.470 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T14:14:52.471 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-09T14:14:52.472 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T14:14:52.472 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T14:14:52.914 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2023-08-09T14:14:52.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2023-08-09T14:14:52.917 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-09T14:14:53.078 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-09T14:14:53.114 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:53.214 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.212+0000 7f480f71f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-09T14:14:53.215 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.212+0000 7f480f71f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-09T14:14:53.215 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.212+0000 7f480f71f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-09T14:14:53.215 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.212+0000 7f480f71f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-09T14:14:53.215 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.212+0000 7f480f71f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-09T14:14:53.215 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:53.213+0000 7f480f71f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-09T14:14:56.075 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-09T14:14:56.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:56.194 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.192+0000 7fca1a067640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-09T14:14:56.194 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.192+0000 7fca1a067640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-09T14:14:56.195 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.192+0000 7fca1a067640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-09T14:14:56.195 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.192+0000 7fca1a067640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-09T14:14:56.195 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.192+0000 7fca1a067640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-09T14:14:56.195 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:56.193+0000 7fca1a067640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-09T14:14:59.054 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-09T14:14:59.085 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:14:59.177 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-09T14:14:59.177 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-09T14:14:59.177 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-09T14:14:59.177 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-09T14:14:59.178 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-09T14:14:59.178 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:14:59.175+0000 7fab6c226640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-09T14:15:02.040 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-09T14:15:02.071 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:15:02.162 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.160+0000 7f1020246640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-09T14:15:02.163 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.160+0000 7f1020246640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-09T14:15:02.163 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.160+0000 7f1020246640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-09T14:15:02.163 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.160+0000 7f1020246640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-09T14:15:02.163 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.160+0000 7f1020246640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-09T14:15:02.163 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:02.161+0000 7f1020246640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-09T14:15:03.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:15:03.357 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:15:05.031 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-09T14:15:05.063 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-09T14:15:05.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-09T14:15:05.096 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-09T14:15:05.168 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-09T14:15:05.239 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-09T14:15:05.310 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-09T14:15:05.379 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-09T14:15:05.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-09T14:15:05.515 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.516 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-09T14:15:05.547 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-09T14:15:05.618 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.618 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-09T14:15:05.688 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.688 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-09T14:15:05.756 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.756 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-09T14:15:05.825 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.825 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-09T14:15:05.893 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:05.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-09T14:15:05.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-09T14:15:05.981 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:05.981 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-09T14:15:06.041 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:06.041 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-09T14:15:06.058 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:06.059 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-09T14:15:06.115 INFO:tasks.ceph:Adding keys to all mons... 2023-08-09T14:15:06.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-09T14:15:06.118 DEBUG:teuthology.orchestra.run.smithi101:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-09T14:15:06.159 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-08-09T14:15:06.159 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkW0jaBRAAVAXnGaN6bxlcMYZcRtUk5w== 2023-08-09T14:15:06.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-08-09T14:15:06.160 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9Nkxx6IDhAAh6fGbGQT8Zs489D8ML/jzg== 2023-08-09T14:15:06.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-08-09T14:15:06.160 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9Nk4S76FRAAvqqBa6qx9ss7DSzihjClyQ== 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBOn9NkcCfCCxAArUTRcF9mweu6a1l+ffuAFg== 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBRn9NkGlFpCxAASZ/WpUIoncYZjR0cZzpz6A== 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBUn9Nkc0O8ChAA85nALOg7BBJJx/ZElfnYiQ== 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-08-09T14:15:06.161 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBXn9Nk0t/2CxAA9HVJQ4xQT3OB2IWLFp8V+A== 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NknqoJCxAA2Zyaj93AlUX1zCUg36XHBQ== 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkrJ8ZGxAA49LvzxDz/hwDeW57a0gylg== 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkFC9eIhAA57JSI1rttlgomykIrgnDoA== 2023-08-09T14:15:06.162 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBdn9Nkjw66DBAALjbqCtEC8v5BxcQG8G9frA== 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBgn9NkwGGHCxAAAskMVCNTzr8IVSSIWyqieA== 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBjn9NkZYh/ChAAuQyDmigIoxW2VMVwdeYklg== 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-08-09T14:15:06.163 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBmn9NknFWgCRAAq60J5i7dZMpPeDGKChy1gA== 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkwcnEJhAANZnn6ZDBepG6wauF6Holcg== 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NklFAvKhAABoiDkwu6jJjQhfj66Rr9/A== 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-08-09T14:15:06.164 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkM0HQLRAAoRH1uJWb+uuKsD9tVQOKLw== 2023-08-09T14:15:06.165 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2023-08-09T14:15:06.165 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9Nko553MxAAcHI10HryL5LlAB1u/RuNcQ== 2023-08-09T14:15:06.181 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr.y] 2023-08-09T14:15:06.181 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NkW0jaBRAAVAXnGaN6bxlcMYZcRtUk5w== 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.a] 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9Nkxx6IDhAAh6fGbGQT8Zs489D8ML/jzg== 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.c] 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9Nk4S76FRAAvqqBa6qx9ss7DSzihjClyQ== 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.0] 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBOn9NkcCfCCxAArUTRcF9mweu6a1l+ffuAFg== 2023-08-09T14:15:06.182 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.1] 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBRn9NkGlFpCxAASZ/WpUIoncYZjR0cZzpz6A== 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.2] 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBUn9Nkc0O8ChAA85nALOg7BBJJx/ZElfnYiQ== 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.3] 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBXn9Nk0t/2CxAA9HVJQ4xQT3OB2IWLFp8V+A== 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr.x] 2023-08-09T14:15:06.183 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NknqoJCxAA2Zyaj93AlUX1zCUg36XHBQ== 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.b] 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NkrJ8ZGxAA49LvzxDz/hwDeW57a0gylg== 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.d] 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NkFC9eIhAA57JSI1rttlgomykIrgnDoA== 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.4] 2023-08-09T14:15:06.184 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBdn9Nkjw66DBAALjbqCtEC8v5BxcQG8G9frA== 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.5] 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBgn9NkwGGHCxAAAskMVCNTzr8IVSSIWyqieA== 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.6] 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBjn9NkZYh/ChAAuQyDmigIoxW2VMVwdeYklg== 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.7] 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBmn9NknFWgCRAAq60J5i7dZMpPeDGKChy1gA== 2023-08-09T14:15:06.185 INFO:teuthology.orchestra.run.smithi101.stdout:[client.0] 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NkwcnEJhAANZnn6ZDBepG6wauF6Holcg== 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout:[client.2] 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NklFAvKhAABoiDkwu6jJjQhfj66Rr9/A== 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout:[client.1] 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9NkM0HQLRAAoRH1uJWb+uuKsD9tVQOKLw== 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout:[client.3] 2023-08-09T14:15:06.186 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQBMn9Nko553MxAAcHI10HryL5LlAB1u/RuNcQ== 2023-08-09T14:15:06.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T14:15:06.208 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T14:15:06.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.284 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.344 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.402 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.456 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.566 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T14:15:06.622 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T14:15:06.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.678 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.735 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T14:15:06.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.793 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.848 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.903 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:06.958 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T14:15:07.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.012 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.071 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.129 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.187 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T14:15:07.243 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-09T14:15:07.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-09T14:15:07.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T14:15:07.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-09T14:15:07.396 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-09T14:15:07.422 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T14:15:07.522 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-09T14:15:07.548 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-09T14:15:07.615 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T14:15:07.711 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-09T14:15:07.737 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:15:07.739 DEBUG:teuthology.orchestra.run.smithi101:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-09T14:15:07.794 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-09T14:15:07.794 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-09T14:15:07.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-09T14:15:07.797 INFO:tasks.ceph.mon.a:Started 2023-08-09T14:15:07.797 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-09T14:15:07.797 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-09T14:15:07.837 INFO:tasks.ceph.mon.b:Started 2023-08-09T14:15:07.837 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-09T14:15:07.837 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-09T14:15:07.839 INFO:tasks.ceph.mon.c:Started 2023-08-09T14:15:07.839 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-09T14:15:07.839 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-09T14:15:07.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-09T14:15:07.842 INFO:tasks.ceph.mgr.y:Started 2023-08-09T14:15:07.842 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-09T14:15:07.843 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-09T14:15:07.845 INFO:tasks.ceph.mgr.x:Started 2023-08-09T14:15:07.845 INFO:tasks.ceph:Setting crush tunables to default 2023-08-09T14:15:07.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-08-09T14:15:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.971+0000 7fb5725cb700 1 Processor -- start 2023-08-09T14:15:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.971+0000 7fb5725cb700 1 -- start start 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.971+0000 7fb5725cb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb56c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb5725cb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb5725cb700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c0715a0 con 0x7fb56c06a1c0 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb5725cb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c0cd6c0 con 0x7fb56c0cd1c0 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb5725cb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0712a0 con 0x7fb56c15d3a0 2023-08-09T14:15:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41938/0 (socket says 172.21.15.5:41938) 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 -- 172.21.15.5:0/476140239 learned_addr learned my addr 172.21.15.5:0/476140239 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 -- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 msgr2=0x7fb56c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 -- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 msgr2=0x7fb56c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-09T14:15:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb56c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56bfff700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 msgr2=0x7fb56c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T14:15:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56bfff700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 msgr2=0x7fb56c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T14:15:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb56c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T14:15:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:07.972+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb56c0af2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-09T14:15:08.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.158+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909920253 0 0) 0x7fb56c0715a0 con 0x7fb56c06a1c0 2023-08-09T14:15:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.158+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5540035b0 con 0x7fb56c06a1c0 2023-08-09T14:15:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v1:172.21.15.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199637842 0 0) 0x7fb5540035b0 con 0x7fb56c06a1c0 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 msgr2=0x7fb56c0af2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb56c0af2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 msgr2=0x7fb56c0cda00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 --2- 172.21.15.5:0/476140239 >> v2:172.21.15.5:3300/0 conn(0x7fb56c0cd1c0 0x7fb56c0cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 --> v1:172.21.15.101:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0cf570 con 0x7fb56c06a1c0 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v1:172.21.15.101:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fb5640019f0 con 0x7fb56c06a1c0 2023-08-09T14:15:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 >> v1:172.21.15.101:6789/0 conn(0x7fb56c06a1c0 legacy=0x7fb56c160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb554003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554004850 0x7fb554004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb554005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0cd6c0 con 0x7fb554004850 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0712a0 con 0x7fb554003a00 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55400bac0 con 0x7fb56c15d3a0 2023-08-09T14:15:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb554003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.164+0000 7fb570b68700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb554005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554004850 0x7fb554004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 msgr2=0x7fb554005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c15d3a0 0x7fb554005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554004850 msgr2=0x7fb554004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554004850 0x7fb554004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 -- 172.21.15.5:0/476140239 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540035b0 con 0x7fb554003a00 2023-08-09T14:15:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554004850 0x7fb554004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.165+0000 7fb56bfff700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb554003e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009860 tx=0x7fb554005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a63521f33bda164 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.166+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00c070 con 0x7fb554003a00 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.166+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c004020 con 0x7fb554003a00 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.166+0000 7fb56affd700 1 -- 172.21.15.5:0/476140239 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0043d0 con 0x7fb554003a00 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 -- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 msgr2=0x7fb554003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 --2- 172.21.15.5:0/476140239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb554003e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009860 tx=0x7fb554005880 comp rx=0 tx=0).stop 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb570b68700 1 -- 172.21.15.5:0/476140239 reap_dead start 2023-08-09T14:15:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 -- 172.21.15.5:0/476140239 shutdown_connections 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 -- 172.21.15.5:0/476140239 >> 172.21.15.5:0/476140239 conn(0x7fb56c0b1970 msgr2=0x7fb56c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 -- 172.21.15.5:0/476140239 shutdown_connections 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.167+0000 7fb5725cb700 1 -- 172.21.15.5:0/476140239 wait complete. 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.168+0000 7fb5725cb700 1 Processor -- start 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 -- start start 2023-08-09T14:15:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb56c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 0x7fb56c1f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c161aa0 con 0x7fb56c148330 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0b5640 con 0x7fb554003a00 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb5725cb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c1f5e70 con 0x7fb56c161610 2023-08-09T14:15:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb56b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb56bfff700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb56c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb56b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41972/0 (socket says 172.21.15.5:41972) 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb56b7fe700 1 -- 172.21.15.5:0/2407631143 learned_addr learned my addr 172.21.15.5:0/2407631143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.169+0000 7fb570b68700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 0x7fb56c1f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 -- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 msgr2=0x7fb56c1f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 0x7fb56c1f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 -- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 msgr2=0x7fb56c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb56c1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 -- 172.21.15.5:0/2407631143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c1f4890 con 0x7fb56c148330 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb570b68700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 0x7fb56c1f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56bfff700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb56c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.170+0000 7fb56b7fe700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5600108c0 tx=0x7fb560010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.171+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560004020 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.171+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000c050 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.171+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c1f4b70 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.171+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600043a0 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.171+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c1f5130 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.172+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb5600036a0 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.172+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb560015b90 con 0x7fb56c148330 2023-08-09T14:15:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.172+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c074600 con 0x7fb56c148330 2023-08-09T14:15:08.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.175+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb56001a030 con 0x7fb56c148330 2023-08-09T14:15:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.252+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb56c0c6790 con 0x7fb56c148330 2023-08-09T14:15:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.255+0000 7fb568ff9700 1 -- 172.21.15.5:0/2407631143 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb56002d020 con 0x7fb56c148330 2023-08-09T14:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 msgr2=0x7fb56c1610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5600108c0 tx=0x7fb560010bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 shutdown_connections 2023-08-09T14:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb56c161610 0x7fb56c1f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb554003a00 0x7fb56c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 --2- 172.21.15.5:0/2407631143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56c148330 0x7fb56c1610d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 >> 172.21.15.5:0/2407631143 conn(0x7fb56c0b1970 msgr2=0x7fb56c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 shutdown_connections 2023-08-09T14:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:08.256+0000 7fb5725cb700 1 -- 172.21.15.5:0/2407631143 wait complete. 2023-08-09T14:15:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-08-09T14:15:08.269 INFO:tasks.ceph:check_enable_crimson: False 2023-08-09T14:15:08.269 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-09T14:15:08.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:08.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-09T14:15:08.277 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:08.276+0000 7f020f2ac200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-09T14:15:08.287 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:08.286+0000 7ff44bda9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-09T14:15:08.297 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:08.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-09T14:15:08.342 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:08.340+0000 7f020f2ac200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-09T14:15:08.358 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:08.357+0000 7ff44bda9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-09T14:15:08.364 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:08.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-09T14:15:08.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:08.415+0000 7f020f2ac200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-09T14:15:08.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:08.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-09T14:15:08.441 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:08.440+0000 7ff44bda9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-09T14:15:08.467 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:08.468 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-09T14:15:08.494 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:08.494 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-09T14:15:08.495 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:08.493+0000 7f020f2ac200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-09T14:15:08.520 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:08.521 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-09T14:15:08.526 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:08.525+0000 7ff44bda9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-09T14:15:08.586 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:08.587 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-09T14:15:08.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:08.648+0000 7f020f2ac200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-09T14:15:08.652 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 8e91ea65-7cc6-4af4-abf6-72c86b4ed85e 0 2023-08-09T14:15:08.677 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:08.675+0000 7ff44bda9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-09T14:15:08.814 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.812+0000 7f55b976b700 1 Processor -- start 2023-08-09T14:15:08.815 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b976b700 1 -- start start 2023-08-09T14:15:08.817 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b976b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55b40cdf80 0x7f55b406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.817 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b976b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b4160cc0 con 0x7f55b40d04b0 2023-08-09T14:15:08.817 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b976b700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b40d08c0 con 0x7f55b415d100 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b976b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b40cecd0 con 0x7f55b40cdf80 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b2ffd700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f55b415d100 0x7f55b40cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.101:57192/0 (socket says 172.21.15.101:57192) 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b2ffd700 1 -- 172.21.15.101:0/1934518090 learned_addr learned my addr 172.21.15.101:0/1934518090 (peer_addr_for_me v1:172.21.15.101:0/0) 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.813+0000 7f55b27fc700 1 --2- 172.21.15.101:0/1934518090 >> v2:172.21.15.5:3300/0 conn(0x7f55b40cdf80 0x7f55b406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310625693 0 0) 0x7f55b40d08c0 con 0x7f55b415d100 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f559c0035b0 con 0x7f55b415d100 2023-08-09T14:15:08.818 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023450358 0 0) 0x7f55b4160cc0 con 0x7f55b40d04b0 2023-08-09T14:15:08.819 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b40d08c0 con 0x7f55b40d04b0 2023-08-09T14:15:08.819 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b27fc700 1 -- 172.21.15.101:0/1934518090 >> v1:172.21.15.101:6789/0 conn(0x7f55b415d100 legacy=0x7f55b40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.819 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.1 v1:172.21.15.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951535923 0 0) 0x7f559c0035b0 con 0x7f55b415d100 2023-08-09T14:15:08.819 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b27fc700 1 -- 172.21.15.101:0/1934518090 >> v1:172.21.15.5:6789/0 conn(0x7f55b40d04b0 legacy=0x7f55b40af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.819 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b27fc700 1 -- 172.21.15.101:0/1934518090 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40d0b50 con 0x7f55b40cdf80 2023-08-09T14:15:08.820 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b27fc700 1 --2- 172.21.15.101:0/1934518090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40cdf80 0x7f55b406cf00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55a40097c0 tx=0x7f55a4009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c391be7c1f6747 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:08.820 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8001670 con 0x7f55b40cdf80 2023-08-09T14:15:08.820 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4004030 con 0x7f55b40cdf80 2023-08-09T14:15:08.820 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.814+0000 7f55b1ffb700 1 -- 172.21.15.101:0/1934518090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a40043a0 con 0x7f55b40cdf80 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 -- 172.21.15.101:0/1934518090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40cdf80 msgr2=0x7f55b406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 --2- 172.21.15.101:0/1934518090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40cdf80 0x7f55b406cf00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55a40097c0 tx=0x7f55a4009ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 -- 172.21.15.101:0/1934518090 shutdown_connections 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 --2- 172.21.15.101:0/1934518090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40cdf80 0x7f55b406cf00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 -- 172.21.15.101:0/1934518090 >> 172.21.15.101:0/1934518090 conn(0x7f55b406dec0 msgr2=0x7f55b406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 -- 172.21.15.101:0/1934518090 shutdown_connections 2023-08-09T14:15:08.821 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.815+0000 7f55b976b700 1 -- 172.21.15.101:0/1934518090 wait complete. 2023-08-09T14:15:08.823 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.816+0000 7f55b976b700 1 Processor -- start 2023-08-09T14:15:08.823 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.816+0000 7f55b976b700 1 -- start start 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40d04b0 0x7f55b40ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 0x7f55b40cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b41f2410 con 0x7f55b40d04b0 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40c5b20 con 0x7f55b415d100 2023-08-09T14:15:08.824 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b976b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b41f3270 con 0x7f55b40cdf80 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b37fe700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 0x7f55b40cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40648/0 (socket says 172.21.15.101:40648) 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b37fe700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 0x7f55b40cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59862/0 (socket says 172.21.15.101:59862) 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40d04b0 0x7f55b40ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 -- 172.21.15.101:0/3048899194 learned_addr learned my addr 172.21.15.101:0/3048899194 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:08.825 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 -- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 msgr2=0x7f55b40cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 0x7f55b40cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 -- 172.21.15.101:0/3048899194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40d04b0 msgr2=0x7f55b40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40d04b0 0x7f55b40ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 -- 172.21.15.101:0/3048899194 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40094a0 con 0x7f55b40cdf80 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.817+0000 7f55b2ffd700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c700 tx=0x7f55a800ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8004c80 con 0x7f55b40cdf80 2023-08-09T14:15:08.826 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8004de0 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b41f25f0 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8007310 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b41f2bb0 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f55a801d3f0 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.818+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f55a8013740 con 0x7f55b40cdf80 2023-08-09T14:15:08.827 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.819+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b40b2ba0 con 0x7f55b40cdf80 2023-08-09T14:15:08.828 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.821+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f55b40b2ba0 con 0x7f55b40cdf80 2023-08-09T14:15:08.905 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.903+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e91ea65-7cc6-4af4-abf6-72c86b4ed85e", "id": 0} v 0) v1 -- 0x7f55b41f33b0 con 0x7f55b40cdf80 2023-08-09T14:15:08.911 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.909+0000 7f559b7fe700 1 -- 172.21.15.101:0/3048899194 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e91ea65-7cc6-4af4-abf6-72c86b4ed85e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55b41f33b0 con 0x7f55b40cdf80 2023-08-09T14:15:08.912 INFO:teuthology.orchestra.run.smithi101.stdout:0 2023-08-09T14:15:08.912 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 msgr2=0x7f55b415bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c700 tx=0x7f55a800ca10 comp rx=0 tx=0).stop 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 shutdown_connections 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f55b415d100 0x7f55b40cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f55b40cdf80 0x7f55b415bb10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 --2- 172.21.15.101:0/3048899194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55b40d04b0 0x7f55b40ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:08.913 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 >> 172.21.15.101:0/3048899194 conn(0x7f55b406dec0 msgr2=0x7f55b40700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:08.914 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 shutdown_connections 2023-08-09T14:15:08.914 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:08.910+0000 7f55b976b700 1 -- 172.21.15.101:0/3048899194 wait complete. 2023-08-09T14:15:08.924 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 3b264185-cb76-4cc6-b71e-aa059ee47a32 1 2023-08-09T14:15:09.042 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.040+0000 7f36a7c0d700 1 Processor -- start 2023-08-09T14:15:09.043 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.041+0000 7f36a7c0d700 1 -- start start 2023-08-09T14:15:09.045 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.041+0000 7f36a7c0d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.046 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.041+0000 7f36a7c0d700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 0x7f36a006a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.046 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a7c0d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00715a0 con 0x7f36a00cd1c0 2023-08-09T14:15:09.046 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a7c0d700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00cd6c0 con 0x7f36a006a1c0 2023-08-09T14:15:09.046 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a7c0d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a006ab90 con 0x7f36a015d3a0 2023-08-09T14:15:09.047 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.047 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a61aa700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 0x7f36a006a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.047 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40654/0 (socket says 172.21.15.101:40654) 2023-08-09T14:15:09.047 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 -- 172.21.15.101:0/3488366094 learned_addr learned my addr 172.21.15.101:0/3488366094 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.048 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 -- 172.21.15.101:0/3488366094 >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 msgr2=0x7f36a006a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:09.048 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 --2- 172.21.15.101:0/3488366094 >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 0x7f36a006a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.048 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 -- 172.21.15.101:0/3488366094 >> v1:172.21.15.5:6789/0 conn(0x7f36a00cd1c0 legacy=0x7f36a00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.048 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 -- 172.21.15.101:0/3488366094 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00712a0 con 0x7f36a015d3a0 2023-08-09T14:15:09.048 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a61aa700 1 --2- 172.21.15.101:0/3488366094 >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 0x7f36a006a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a59a9700 1 --2- 172.21.15.101:0/3488366094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098f0 tx=0x7f369c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43132342ae94841f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a49a7700 1 -- 172.21.15.101:0/3488366094 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011830 con 0x7f36a015d3a0 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a49a7700 1 -- 172.21.15.101:0/3488366094 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c011990 con 0x7f36a015d3a0 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.042+0000 7f36a49a7700 1 -- 172.21.15.101:0/3488366094 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011d20 con 0x7f36a015d3a0 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 -- 172.21.15.101:0/3488366094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 msgr2=0x7f36a00af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/3488366094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098f0 tx=0x7f369c009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:09.049 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 -- 172.21.15.101:0/3488366094 shutdown_connections 2023-08-09T14:15:09.050 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/3488366094 >> v2:172.21.15.101:3300/0 conn(0x7f36a006a1c0 0x7f36a006a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.050 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/3488366094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a015d3a0 0x7f36a00af2c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.050 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 -- 172.21.15.101:0/3488366094 >> 172.21.15.101:0/3488366094 conn(0x7f36a00b1970 msgr2=0x7f36a00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.050 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 -- 172.21.15.101:0/3488366094 shutdown_connections 2023-08-09T14:15:09.050 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.043+0000 7f36a7c0d700 1 -- 172.21.15.101:0/3488366094 wait complete. 2023-08-09T14:15:09.052 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.044+0000 7f36a7c0d700 1 Processor -- start 2023-08-09T14:15:09.052 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.044+0000 7f36a7c0d700 1 -- start start 2023-08-09T14:15:09.052 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 0x7f36a00cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a015d3a0 0x7f36a0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c38d0 con 0x7f36a015d3a0 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c4730 con 0x7f36a006a1c0 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a7c0d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a015eaa0 con 0x7f36a00cd1c0 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a51a8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a51a8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40662/0 (socket says 172.21.15.101:40662) 2023-08-09T14:15:09.053 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a51a8700 1 -- 172.21.15.101:0/2891064868 learned_addr learned my addr 172.21.15.101:0/2891064868 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 0x7f36a00cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a61aa700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a015d3a0 0x7f36a0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 -- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 msgr2=0x7f36a015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 -- 172.21.15.101:0/2891064868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a015d3a0 msgr2=0x7f36a0160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a015d3a0 0x7f36a0160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.054 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 -- 172.21.15.101:0/2891064868 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009a70 con 0x7f36a006a1c0 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a51a8700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.045+0000 7f36a59a9700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 0x7f36a00cb570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098f0 tx=0x7f369c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c004340 con 0x7f36a006a1c0 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c01f070 con 0x7f36a006a1c0 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c009550 con 0x7f36a006a1c0 2023-08-09T14:15:09.055 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0036a0 con 0x7f36a006a1c0 2023-08-09T14:15:09.056 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00c3e00 con 0x7f36a006a1c0 2023-08-09T14:15:09.056 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f369c021030 con 0x7f36a006a1c0 2023-08-09T14:15:09.056 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.046+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f369c01a9f0 con 0x7f36a006a1c0 2023-08-09T14:15:09.056 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.047+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a0074600 con 0x7f36a006a1c0 2023-08-09T14:15:09.056 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.049+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f369c015020 con 0x7f36a006a1c0 2023-08-09T14:15:09.063 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:09.062+0000 7f020f2ac200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-09T14:15:09.088 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:09.086+0000 7ff44bda9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-09T14:15:09.134 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.132+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b264185-cb76-4cc6-b71e-aa059ee47a32", "id": 1} v 0) v1 -- 0x7f36a00b27c0 con 0x7f36a006a1c0 2023-08-09T14:15:09.140 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.138+0000 7f36967fc700 1 -- 172.21.15.101:0/2891064868 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b264185-cb76-4cc6-b71e-aa059ee47a32", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f369c003db0 con 0x7f36a006a1c0 2023-08-09T14:15:09.140 INFO:teuthology.orchestra.run.smithi101.stdout:1 2023-08-09T14:15:09.141 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 msgr2=0x7f36a00cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.141 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 0x7f36a00cb570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098f0 tx=0x7f369c004750 comp rx=0 tx=0).stop 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 shutdown_connections 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a015d3a0 0x7f36a0160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f36a006a1c0 0x7f36a00cb570 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 --2- 172.21.15.101:0/2891064868 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f36a00cd1c0 0x7f36a015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 >> 172.21.15.101:0/2891064868 conn(0x7f36a00b1970 msgr2=0x7f36a0160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 shutdown_connections 2023-08-09T14:15:09.142 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.139+0000 7f36a7c0d700 1 -- 172.21.15.101:0/2891064868 wait complete. 2023-08-09T14:15:09.154 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 24133eef-ab37-45a0-89b5-826847465f60 2 2023-08-09T14:15:09.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:09.183+0000 7f020f2ac200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-09T14:15:09.209 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:09.208+0000 7ff44bda9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-09T14:15:09.274 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.272+0000 7ff6d31d2700 1 Processor -- start 2023-08-09T14:15:09.274 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.272+0000 7ff6d31d2700 1 -- start start 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d31d2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6cc0b6170 0x7ff6cc15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d31d2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0cf500 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d31d2700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0cb910 con 0x7ff6cc0cb4b0 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d31d2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc15fc90 con 0x7ff6cc0b6170 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6cbfff700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7ff6cc0cb4b0 0x7ff6cc0b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.101:57218/0 (socket says 172.21.15.101:57218) 2023-08-09T14:15:09.277 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6cbfff700 1 -- 172.21.15.101:0/4037309646 learned_addr learned my addr 172.21.15.101:0/4037309646 (peer_addr_for_me v1:172.21.15.101:0/0) 2023-08-09T14:15:09.278 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/4037309646 >> v2:172.21.15.5:3300/0 conn(0x7ff6cc0b6170 0x7ff6cc15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.278 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6cb7fe700 1 -- 172.21.15.101:0/4037309646 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016152149 0 0) 0x7ff6cc0cb910 con 0x7ff6cc0cb4b0 2023-08-09T14:15:09.278 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6cb7fe700 1 -- 172.21.15.101:0/4037309646 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b80035b0 con 0x7ff6cc0cb4b0 2023-08-09T14:15:09.278 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/4037309646 >> v1:172.21.15.101:6789/0 conn(0x7ff6cc0cb4b0 legacy=0x7ff6cc0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.278 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.273+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/4037309646 >> v1:172.21.15.5:6789/0 conn(0x7ff6cc0b2ff0 legacy=0x7ff6cc151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.279 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/4037309646 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc15c670 con 0x7ff6cc0b6170 2023-08-09T14:15:09.279 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/4037309646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b6170 0x7ff6cc15f640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009840 tx=0x7ff6bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938b4d736ee8e0c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.279 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6cb7fe700 1 -- 172.21.15.101:0/4037309646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc011830 con 0x7ff6cc0b6170 2023-08-09T14:15:09.279 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6cb7fe700 1 -- 172.21.15.101:0/4037309646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc011990 con 0x7ff6cc0b6170 2023-08-09T14:15:09.279 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6cb7fe700 1 -- 172.21.15.101:0/4037309646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc011d20 con 0x7ff6cc0b6170 2023-08-09T14:15:09.280 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 -- 172.21.15.101:0/4037309646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b6170 msgr2=0x7ff6cc15f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.280 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/4037309646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b6170 0x7ff6cc15f640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009840 tx=0x7ff6bc009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:09.280 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 -- 172.21.15.101:0/4037309646 shutdown_connections 2023-08-09T14:15:09.280 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/4037309646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b6170 0x7ff6cc15f640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.281 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 -- 172.21.15.101:0/4037309646 >> 172.21.15.101:0/4037309646 conn(0x7ff6cc06dec0 msgr2=0x7ff6cc06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.281 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 -- 172.21.15.101:0/4037309646 shutdown_connections 2023-08-09T14:15:09.281 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.274+0000 7ff6d31d2700 1 -- 172.21.15.101:0/4037309646 wait complete. 2023-08-09T14:15:09.281 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.276+0000 7ff6d31d2700 1 Processor -- start 2023-08-09T14:15:09.282 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.276+0000 7ff6d31d2700 1 -- start start 2023-08-09T14:15:09.282 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:09.276+0000 7f020f2ac200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-09T14:15:09.284 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.276+0000 7ff6d31d2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 0x7ff6cc0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.284 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.276+0000 7ff6d31d2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 0x7ff6cc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.284 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.284 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c7b50 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc06c050 con 0x7ff6cc0cb4b0 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc06c330 con 0x7ff6cc0b6170 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d176f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6cbfff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 0x7ff6cc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d176f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59886/0 (socket says 172.21.15.101:59886) 2023-08-09T14:15:09.285 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d176f700 1 -- 172.21.15.101:0/3912936320 learned_addr learned my addr 172.21.15.101:0/3912936320 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 0x7ff6cc0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 msgr2=0x7ff6cc0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 0x7ff6cc0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 msgr2=0x7ff6cc15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 -- 172.21.15.101:0/3912936320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0094a0 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6cbfff700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 0x7ff6cc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.286 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d176f700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.287 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d0f6e700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 0x7ff6cc0c7610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc016000 tx=0x7ff6bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.287 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0036a0 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.287 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc01f070 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.287 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc06c610 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.287 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc003a20 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.288 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.277+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc06cbd0 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.288 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.278+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6bc026480 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.288 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.278+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff6bc021070 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.288 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.279+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc074600 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.288 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.281+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff6bc02b020 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.314 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:09.313+0000 7ff44bda9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-09T14:15:09.361 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:09.359+0000 7f020f2ac200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-09T14:15:09.366 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.365+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24133eef-ab37-45a0-89b5-826847465f60", "id": 2} v 0) v1 -- 0x7ff6cc155960 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.369 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.367+0000 7ff6c97fa700 1 -- 172.21.15.101:0/3912936320 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24133eef-ab37-45a0-89b5-826847465f60", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6bc015020 con 0x7ff6cc0b2ff0 2023-08-09T14:15:09.369 INFO:teuthology.orchestra.run.smithi101.stdout:2 2023-08-09T14:15:09.370 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 msgr2=0x7ff6cc0c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.370 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 0x7ff6cc0c7610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc016000 tx=0x7ff6bc004750 comp rx=0 tx=0).stop 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 shutdown_connections 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff6cc0cb4b0 0x7ff6cc15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6cc0b2ff0 0x7ff6cc0c7610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 --2- 172.21.15.101:0/3912936320 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff6cc0b6170 0x7ff6cc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 >> 172.21.15.101:0/3912936320 conn(0x7ff6cc06dec0 msgr2=0x7ff6cc0d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 shutdown_connections 2023-08-09T14:15:09.371 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.368+0000 7ff6d31d2700 1 -- 172.21.15.101:0/3912936320 wait complete. 2023-08-09T14:15:09.382 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 44082c38-6061-4073-8974-5cd82e524f2f 3 2023-08-09T14:15:09.399 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:09.398+0000 7ff44bda9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-09T14:15:09.545 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.543+0000 7f7793285700 1 Processor -- start 2023-08-09T14:15:09.545 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.543+0000 7f7793285700 1 -- start start 2023-08-09T14:15:09.547 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.548 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f778c0b2c70 0x7f778c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.548 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.548 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0cee00 con 0x7f778c0b2c70 2023-08-09T14:15:09.548 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0cb2d0 con 0x7f778c159e90 2023-08-09T14:15:09.548 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7793285700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0cb5b0 con 0x7f778c0ce410 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791021700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791021700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59888/0 (socket says 172.21.15.101:59888) 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40682/0 (socket says 172.21.15.101:40682) 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791021700 1 -- 172.21.15.101:0/3267419655 learned_addr learned my addr 172.21.15.101:0/3267419655 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.549 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7790820700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.5:3300/0 conn(0x7f778c0b2c70 0x7f778c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.550 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 -- 172.21.15.101:0/3267419655 >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 msgr2=0x7f778c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:09.550 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.550 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 -- 172.21.15.101:0/3267419655 >> v2:172.21.15.5:3300/0 conn(0x7f778c0b2c70 msgr2=0x7f778c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:09.550 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.5:3300/0 conn(0x7f778c0b2c70 0x7f778c06db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.551 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.544+0000 7f7791822700 1 -- 172.21.15.101:0/3267419655 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0cb890 con 0x7f778c0ce410 2023-08-09T14:15:09.551 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7791021700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.551 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7791822700 1 --2- 172.21.15.101:0/3267419655 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f778c072a90 tx=0x7f778400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f444036c696d4f8e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.552 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7783fff700 1 -- 172.21.15.101:0/3267419655 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400e070 con 0x7f778c0ce410 2023-08-09T14:15:09.552 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7783fff700 1 -- 172.21.15.101:0/3267419655 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400bb20 con 0x7f778c0ce410 2023-08-09T14:15:09.552 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7783fff700 1 -- 172.21.15.101:0/3267419655 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784012430 con 0x7f778c0ce410 2023-08-09T14:15:09.553 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 -- 172.21.15.101:0/3267419655 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 msgr2=0x7f778c0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.553 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 --2- 172.21.15.101:0/3267419655 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f778c072a90 tx=0x7f778400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:09.553 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 -- 172.21.15.101:0/3267419655 shutdown_connections 2023-08-09T14:15:09.553 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.101:3300/0 conn(0x7f778c159e90 0x7f778c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.554 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 --2- 172.21.15.101:0/3267419655 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c0ce410 0x7f778c0ce8c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.554 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 --2- 172.21.15.101:0/3267419655 >> v2:172.21.15.5:3300/0 conn(0x7f778c0b2c70 0x7f778c06db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.554 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.545+0000 7f7793285700 1 -- 172.21.15.101:0/3267419655 >> 172.21.15.101:0/3267419655 conn(0x7f778c0b1970 msgr2=0x7f778c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.555 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.546+0000 7f7793285700 1 -- 172.21.15.101:0/3267419655 shutdown_connections 2023-08-09T14:15:09.555 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.546+0000 7f7793285700 1 -- 172.21.15.101:0/3267419655 wait complete. 2023-08-09T14:15:09.558 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 Processor -- start 2023-08-09T14:15:09.558 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 -- start start 2023-08-09T14:15:09.558 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778c0b2c70 0x7f778c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.559 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.559 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c159e90 0x7f778c1eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.559 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0a9100 con 0x7f778c0b2c70 2023-08-09T14:15:09.560 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0c73b0 con 0x7f778c0ce410 2023-08-09T14:15:09.560 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.547+0000 7f7793285700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1ef4e0 con 0x7f778c159e90 2023-08-09T14:15:09.560 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.560 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59896/0 (socket says 172.21.15.101:59896) 2023-08-09T14:15:09.560 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7791822700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c159e90 0x7f778c1eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 -- 172.21.15.101:0/3862110082 learned_addr learned my addr 172.21.15.101:0/3862110082 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7791021700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778c0b2c70 0x7f778c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 -- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c159e90 msgr2=0x7f778c1eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c159e90 0x7f778c1eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 -- 172.21.15.101:0/3862110082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778c0b2c70 msgr2=0x7f778c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778c0b2c70 0x7f778c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.561 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 -- 172.21.15.101:0/3862110082 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778800b7f0 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7790820700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f777c00e930 tx=0x7f777c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c013680 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0137e0 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7784009a70 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c013b70 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.548+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1efef0 con 0x7f778c0ce410 2023-08-09T14:15:09.562 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.549+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f777c005a20 con 0x7f778c0ce410 2023-08-09T14:15:09.563 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.549+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f777c006700 con 0x7f778c0ce410 2023-08-09T14:15:09.563 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.549+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c1f0b00 con 0x7f778c0ce410 2023-08-09T14:15:09.563 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.552+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f777c021060 con 0x7f778c0ce410 2023-08-09T14:15:09.637 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.635+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44082c38-6061-4073-8974-5cd82e524f2f", "id": 3} v 0) v1 -- 0x7f778c06e020 con 0x7f778c0ce410 2023-08-09T14:15:09.640 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.638+0000 7f7781ffb700 1 -- 172.21.15.101:0/3862110082 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44082c38-6061-4073-8974-5cd82e524f2f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f777c017070 con 0x7f778c0ce410 2023-08-09T14:15:09.640 INFO:teuthology.orchestra.run.smithi101.stdout:3 2023-08-09T14:15:09.641 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 msgr2=0x7f778c0c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.641 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f777c00e930 tx=0x7f777c00ec40 comp rx=0 tx=0).stop 2023-08-09T14:15:09.641 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 shutdown_connections 2023-08-09T14:15:09.641 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f778c159e90 0x7f778c1eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.642 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778c0b2c70 0x7f778c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.642 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 --2- 172.21.15.101:0/3862110082 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f778c0ce410 0x7f778c0c6e70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.642 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 >> 172.21.15.101:0/3862110082 conn(0x7f778c0b1970 msgr2=0x7f778c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.642 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 shutdown_connections 2023-08-09T14:15:09.642 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.639+0000 7f7793285700 1 -- 172.21.15.101:0/3862110082 wait complete. 2023-08-09T14:15:09.652 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 161d5ace-3e03-4dda-8f66-bedfe3793e91 4 2023-08-09T14:15:09.773 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.768+0000 7f5a0046a700 1 Processor -- start 2023-08-09T14:15:09.773 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.768+0000 7f5a0046a700 1 -- start start 2023-08-09T14:15:09.773 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f5a0046a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.774 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f5a0046a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.774 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f5a0046a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f806bce0 con 0x7f59f80ccd40 2023-08-09T14:15:09.774 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f5a0046a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f806cb50 con 0x7f59f80b0420 2023-08-09T14:15:09.774 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f5a0046a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f806ccf0 con 0x7f59f80cc960 2023-08-09T14:15:09.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fea07700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fea07700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59902/0 (socket says 172.21.15.101:59902) 2023-08-09T14:15:09.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40690/0 (socket says 172.21.15.101:40690) 2023-08-09T14:15:09.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fea07700 1 -- 172.21.15.101:0/1354839016 learned_addr learned my addr 172.21.15.101:0/1354839016 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 -- 172.21.15.101:0/1354839016 >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 msgr2=0x7f59f80d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:09.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 --2- 172.21.15.101:0/1354839016 >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 -- 172.21.15.101:0/1354839016 >> v1:172.21.15.5:6789/0 conn(0x7f59f80ccd40 legacy=0x7f59f8160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fe206700 1 -- 172.21.15.101:0/1354839016 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f806c210 con 0x7f59f80cc960 2023-08-09T14:15:09.777 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.769+0000 7f59fea07700 1 --2- 172.21.15.101:0/1354839016 >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.777 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f59fe206700 1 --2- 172.21.15.101:0/1354839016 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009840 tx=0x7f59f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f703c2f4d3dd8955 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.777 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f59fd204700 1 -- 172.21.15.101:0/1354839016 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011830 con 0x7f59f80cc960 2023-08-09T14:15:09.777 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f59fd204700 1 -- 172.21.15.101:0/1354839016 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4011990 con 0x7f59f80cc960 2023-08-09T14:15:09.778 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f59fd204700 1 -- 172.21.15.101:0/1354839016 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011d20 con 0x7f59f80cc960 2023-08-09T14:15:09.778 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 -- 172.21.15.101:0/1354839016 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 msgr2=0x7f59f806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.778 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 --2- 172.21.15.101:0/1354839016 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009840 tx=0x7f59f4009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:09.778 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 -- 172.21.15.101:0/1354839016 shutdown_connections 2023-08-09T14:15:09.778 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 --2- 172.21.15.101:0/1354839016 >> v2:172.21.15.101:3300/0 conn(0x7f59f80b0420 0x7f59f80d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.779 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 --2- 172.21.15.101:0/1354839016 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80cc960 0x7f59f806c610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.779 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.770+0000 7f5a0046a700 1 -- 172.21.15.101:0/1354839016 >> 172.21.15.101:0/1354839016 conn(0x7f59f806dec0 msgr2=0x7f59f806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.779 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.771+0000 7f5a0046a700 1 -- 172.21.15.101:0/1354839016 shutdown_connections 2023-08-09T14:15:09.779 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.771+0000 7f5a0046a700 1 -- 172.21.15.101:0/1354839016 wait complete. 2023-08-09T14:15:09.782 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 Processor -- start 2023-08-09T14:15:09.782 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 -- start start 2023-08-09T14:15:09.783 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f80b0420 0x7f59f81f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.783 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.783 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 0x7f59f80c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:09.783 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80b6460 con 0x7f59f80b0420 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80b58e0 con 0x7f59f80cc960 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.772+0000 7f5a0046a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80b5bc0 con 0x7f59f80ccd40 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fea07700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 0x7f59f80c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59906/0 (socket says 172.21.15.101:59906) 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 -- 172.21.15.101:0/3020723253 learned_addr learned my addr 172.21.15.101:0/3020723253 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:09.784 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fe206700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f80b0420 0x7f59f81f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 -- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 msgr2=0x7f59f80c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 0x7f59f80c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 -- 172.21.15.101:0/3020723253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f80b0420 msgr2=0x7f59f81f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f80b0420 0x7f59f81f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 -- 172.21.15.101:0/3020723253 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f0009b30 con 0x7f59f80cc960 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fea07700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 0x7f59f80c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59fda05700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c4e0 tx=0x7f59e800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:09.785 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e80052d0 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8005430 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f40094a0 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e80038c0 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.773+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f80b6180 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.774+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f59e8003d20 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.774+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f59e8011db0 con 0x7f59f80cc960 2023-08-09T14:15:09.786 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.774+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8074600 con 0x7f59f80cc960 2023-08-09T14:15:09.787 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.778+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f59e8017070 con 0x7f59f80cc960 2023-08-09T14:15:09.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:09.819+0000 7f020f2ac200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-09T14:15:09.852 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:09.851+0000 7ff44bda9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-09T14:15:09.862 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.860+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd new", "uuid": "161d5ace-3e03-4dda-8f66-bedfe3793e91", "id": 4} v 0) v1 -- 0x7f59f806fe90 con 0x7f59f80cc960 2023-08-09T14:15:09.866 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.864+0000 7f59eeffd700 1 -- 172.21.15.101:0/3020723253 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "161d5ace-3e03-4dda-8f66-bedfe3793e91", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59e8011590 con 0x7f59f80cc960 2023-08-09T14:15:09.866 INFO:teuthology.orchestra.run.smithi101.stdout:4 2023-08-09T14:15:09.867 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 msgr2=0x7f59f80c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:09.867 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c4e0 tx=0x7f59e800c7f0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.867 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 shutdown_connections 2023-08-09T14:15:09.867 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59f80ccd40 0x7f59f80c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.867 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f80b0420 0x7f59f81f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.868 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 --2- 172.21.15.101:0/3020723253 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59f80cc960 0x7f59f80c7f30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:09.868 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 >> 172.21.15.101:0/3020723253 conn(0x7f59f806dec0 msgr2=0x7f59f80d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:09.868 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 shutdown_connections 2023-08-09T14:15:09.868 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.865+0000 7f5a0046a700 1 -- 172.21.15.101:0/3020723253 wait complete. 2023-08-09T14:15:09.879 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 79bf2d03-0373-4431-8e63-28fe26b387a3 5 2023-08-09T14:15:10.004 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.998+0000 7f051999e700 1 Processor -- start 2023-08-09T14:15:10.005 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.998+0000 7f051999e700 1 -- start start 2023-08-09T14:15:10.005 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051999e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051415e530 0x7f05140b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.005 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051999e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 0x7f05140cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.005 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051999e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140b1e40 con 0x7f05140cb8d0 2023-08-09T14:15:10.006 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051999e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140cdf50 con 0x7f051415e530 2023-08-09T14:15:10.006 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051999e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140ce890 con 0x7f05140cd590 2023-08-09T14:15:10.006 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051919d700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f05140cb8d0 0x7f05140cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.101:57248/0 (socket says 172.21.15.101:57248) 2023-08-09T14:15:10.007 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 0x7f05140cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.007 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051919d700 1 -- 172.21.15.101:0/4143877949 learned_addr learned my addr 172.21.15.101:0/4143877949 (peer_addr_for_me v1:172.21.15.101:0/0) 2023-08-09T14:15:10.008 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f051899c700 1 --2- 172.21.15.101:0/4143877949 >> v2:172.21.15.5:3300/0 conn(0x7f051415e530 0x7f05140b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.008 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f05137fe700 1 -- 172.21.15.101:0/4143877949 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230377216 0 0) 0x7f05140b1e40 con 0x7f05140cb8d0 2023-08-09T14:15:10.008 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 -- 172.21.15.101:0/4143877949 >> v2:172.21.15.5:3300/0 conn(0x7f051415e530 msgr2=0x7f05140b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:10.009 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 --2- 172.21.15.101:0/4143877949 >> v2:172.21.15.5:3300/0 conn(0x7f051415e530 0x7f05140b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.009 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 -- 172.21.15.101:0/4143877949 >> v1:172.21.15.101:6789/0 conn(0x7f05140cb8d0 legacy=0x7f05140cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.009 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 -- 172.21.15.101:0/4143877949 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140cc590 con 0x7f05140cd590 2023-08-09T14:15:10.009 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:09.999+0000 7f0513fff700 1 --2- 172.21.15.101:0/4143877949 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 0x7f05140cda10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0500009840 tx=0x7f0500009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b209ae006adc23a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f05137fe700 1 -- 172.21.15.101:0/4143877949 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011830 con 0x7f05140cd590 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f05137fe700 1 -- 172.21.15.101:0/4143877949 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500011990 con 0x7f05140cd590 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f05137fe700 1 -- 172.21.15.101:0/4143877949 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011d20 con 0x7f05140cd590 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 -- 172.21.15.101:0/4143877949 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 msgr2=0x7f05140cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 --2- 172.21.15.101:0/4143877949 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 0x7f05140cda10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0500009840 tx=0x7f0500009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:10.010 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 -- 172.21.15.101:0/4143877949 shutdown_connections 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 --2- 172.21.15.101:0/4143877949 >> v2:172.21.15.5:3300/0 conn(0x7f051415e530 0x7f05140b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 --2- 172.21.15.101:0/4143877949 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cd590 0x7f05140cda10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 -- 172.21.15.101:0/4143877949 >> 172.21.15.101:0/4143877949 conn(0x7f051409a010 msgr2=0x7f05140d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 -- 172.21.15.101:0/4143877949 shutdown_connections 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.000+0000 7f051999e700 1 -- 172.21.15.101:0/4143877949 wait complete. 2023-08-09T14:15:10.011 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.002+0000 7f051999e700 1 Processor -- start 2023-08-09T14:15:10.012 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.002+0000 7f051999e700 1 -- start start 2023-08-09T14:15:10.014 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.002+0000 7f051999e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.002+0000 7f051999e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 0x7f05140c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.002+0000 7f051999e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f051415e530 0x7f0514158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051999e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c5470 con 0x7f05140cd590 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051999e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c47f0 con 0x7f051415e530 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051999e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c4ad0 con 0x7f05140cb8d0 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.015 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051919d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f051415e530 0x7f0514158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.016 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40706/0 (socket says 172.21.15.101:40706) 2023-08-09T14:15:10.016 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 -- 172.21.15.101:0/3273242898 learned_addr learned my addr 172.21.15.101:0/3273242898 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:10.016 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f0513fff700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 0x7f05140c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.016 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 -- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f051415e530 msgr2=0x7f0514158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f051415e530 0x7f0514158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 -- 172.21.15.101:0/3273242898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 msgr2=0x7f05140c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 0x7f05140c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 -- 172.21.15.101:0/3273242898 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000094a0 con 0x7f05140cb8d0 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f0513fff700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 0x7f05140c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:10.017 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051899c700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f050800e900 tx=0x7f050800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508013680 con 0x7f05140cb8d0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140c4db0 con 0x7f05140cb8d0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080137e0 con 0x7f05140cb8d0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508013b50 con 0x7f05140cb8d0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0514155870 con 0x7f05140cb8d0 2023-08-09T14:15:10.018 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.003+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f050801c450 con 0x7f05140cb8d0 2023-08-09T14:15:10.019 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.004+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0508012b30 con 0x7f05140cb8d0 2023-08-09T14:15:10.019 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.004+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140ceac0 con 0x7f05140cb8d0 2023-08-09T14:15:10.019 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.006+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f05140ceac0 con 0x7f05140cb8d0 2023-08-09T14:15:10.092 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.090+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79bf2d03-0373-4431-8e63-28fe26b387a3", "id": 5} v 0) v1 -- 0x7f051404ede0 con 0x7f05140cb8d0 2023-08-09T14:15:10.098 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.096+0000 7f05117fa700 1 -- 172.21.15.101:0/3273242898 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79bf2d03-0373-4431-8e63-28fe26b387a3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0508021060 con 0x7f05140cb8d0 2023-08-09T14:15:10.099 INFO:teuthology.orchestra.run.smithi101.stdout:5 2023-08-09T14:15:10.101 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 msgr2=0x7f0514155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.101 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f050800e900 tx=0x7f050800ec10 comp rx=0 tx=0).stop 2023-08-09T14:15:10.102 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 shutdown_connections 2023-08-09T14:15:10.102 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f051415e530 0x7f0514158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.103 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05140cb8d0 0x7f0514155330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.103 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 --2- 172.21.15.101:0/3273242898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05140cd590 0x7f05140c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.103 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 >> 172.21.15.101:0/3273242898 conn(0x7f051409a010 msgr2=0x7f0514157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.105 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 shutdown_connections 2023-08-09T14:15:10.106 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.097+0000 7f051999e700 1 -- 172.21.15.101:0/3273242898 wait complete. 2023-08-09T14:15:10.111 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544 6 2023-08-09T14:15:10.246 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.243+0000 7f36047a8700 1 Processor -- start 2023-08-09T14:15:10.246 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.243+0000 7f36047a8700 1 -- start start 2023-08-09T14:15:10.247 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f36047a8700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f35fc175030 0x7f35fc177420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.247 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f36047a8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc06cd60 con 0x7f35fc16aa40 2023-08-09T14:15:10.247 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f36047a8700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0cb2c0 con 0x7f35fc0cc880 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f36047a8700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0cb5a0 con 0x7f35fc175030 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3602544700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f35fc0cc880 0x7f35fc0ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.101:57262/0 (socket says 172.21.15.101:57262) 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3602544700 1 -- 172.21.15.101:0/3048765805 learned_addr learned my addr 172.21.15.101:0/3048765805 (peer_addr_for_me v1:172.21.15.101:0/0) 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3602d45700 1 --2- 172.21.15.101:0/3048765805 >> v2:172.21.15.101:3300/0 conn(0x7f35fc175030 0x7f35fc177420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444519464 0 0) 0x7f35fc0cb2c0 con 0x7f35fc0cc880 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e80035b0 con 0x7f35fc0cc880 2023-08-09T14:15:10.248 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562002136 0 0) 0x7f35fc06cd60 con 0x7f35fc16aa40 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35fc0cb2c0 con 0x7f35fc16aa40 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258799337 0 0) 0x7f35fc0cb2c0 con 0x7f35fc16aa40 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 >> v2:172.21.15.101:3300/0 conn(0x7f35fc175030 msgr2=0x7f35fc177420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.245+0000 7f3601542700 1 --2- 172.21.15.101:0/3048765805 >> v2:172.21.15.101:3300/0 conn(0x7f35fc175030 0x7f35fc177420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 >> v1:172.21.15.101:6789/0 conn(0x7f35fc0cc880 legacy=0x7f35fc0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0ce100 con 0x7f35fc16aa40 2023-08-09T14:15:10.249 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f35ec001670 con 0x7f35fc16aa40 2023-08-09T14:15:10.250 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 >> v1:172.21.15.5:6789/0 conn(0x7f35fc16aa40 legacy=0x7f35fc16aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.250 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8003bc0 0x7f35e8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.250 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 0x7f35e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8005210 0x7f35e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8001230 con 0x7f35e8005210 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0cb5a0 con 0x7f35e8003bc0 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e800c030 con 0x7f35e8004850 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 0x7f35e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3602544700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8003bc0 0x7f35e8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 -- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8003bc0 msgr2=0x7f35e8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:10.251 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8003bc0 0x7f35e8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 -- 172.21.15.101:0/3048765805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8005210 msgr2=0x7f35e800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8005210 0x7f35e800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 -- 172.21.15.101:0/3048765805 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0cb2c0 con 0x7f35e8004850 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3601d43700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 0x7f35e8004cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c110 tx=0x7f35e8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5704a86b0988cfc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.246+0000 7f3602d45700 1 -- 172.21.15.101:0/3048765805 reap_dead start 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.247+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec007ae0 con 0x7f35e8004850 2023-08-09T14:15:10.252 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.247+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00cc10 con 0x7f35e8004850 2023-08-09T14:15:10.253 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.247+0000 7f3601542700 1 -- 172.21.15.101:0/3048765805 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec012420 con 0x7f35e8004850 2023-08-09T14:15:10.253 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.247+0000 7f36047a8700 1 -- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 msgr2=0x7f35e8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.253 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.247+0000 7f36047a8700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 0x7f35e8004cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c110 tx=0x7f35e8005880 comp rx=0 tx=0).stop 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.249+0000 7f36047a8700 1 -- 172.21.15.101:0/3048765805 shutdown_connections 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.249+0000 7f36047a8700 1 --2- 172.21.15.101:0/3048765805 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35e8004850 0x7f35e8004cd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.249+0000 7f36047a8700 1 -- 172.21.15.101:0/3048765805 >> 172.21.15.101:0/3048765805 conn(0x7f35fc0cecb0 msgr2=0x7f35fc0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.249+0000 7f36047a8700 1 -- 172.21.15.101:0/3048765805 shutdown_connections 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.250+0000 7f36047a8700 1 -- 172.21.15.101:0/3048765805 wait complete. 2023-08-09T14:15:10.254 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.251+0000 7f36047a8700 1 Processor -- start 2023-08-09T14:15:10.255 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.252+0000 7f36047a8700 1 -- start start 2023-08-09T14:15:10.255 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 0x7f35fc1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.255 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 0x7f35fc0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc16a890 con 0x7f35fc0a9dd0 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b26c0 con 0x7f35e8004850 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f36047a8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0adea0 con 0x7f35fc0a9950 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3602544700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 0x7f35fc1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.256 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3602544700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 0x7f35fc1685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.101:59930/0 (socket says 172.21.15.101:59930) 2023-08-09T14:15:10.257 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40722/0 (socket says 172.21.15.101:40722) 2023-08-09T14:15:10.257 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3602544700 1 -- 172.21.15.101:0/1826634380 learned_addr learned my addr 172.21.15.101:0/1826634380 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:10.257 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3602d45700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 0x7f35fc0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.259 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 -- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 msgr2=0x7f35fc1685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.260 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 0x7f35fc1685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.260 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 -- 172.21.15.101:0/1826634380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 msgr2=0x7f35fc0b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.260 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 0x7f35fc0b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.260 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3601d43700 1 -- 172.21.15.101:0/1826634380 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0b23e0 con 0x7f35fc0a9950 2023-08-09T14:15:10.261 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.253+0000 7f3602d45700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 0x7f35fc0b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:10.261 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f3601d43700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35ec016000 tx=0x7f35ec001980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.261 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec001630 con 0x7f35fc0a9950 2023-08-09T14:15:10.261 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec020070 con 0x7f35fc0a9950 2023-08-09T14:15:10.262 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec005300 con 0x7f35fc0a9950 2023-08-09T14:15:10.262 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0b3330 con 0x7f35fc0a9950 2023-08-09T14:15:10.263 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc0b38f0 con 0x7f35fc0a9950 2023-08-09T14:15:10.263 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f35ec022030 con 0x7f35fc0a9950 2023-08-09T14:15:10.263 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.254+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f35ec025c70 con 0x7f35fc0a9950 2023-08-09T14:15:10.264 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.255+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc0b3c60 con 0x7f35fc0a9950 2023-08-09T14:15:10.270 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.259+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f35ec007c40 con 0x7f35fc0a9950 2023-08-09T14:15:10.353 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.351+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544", "id": 6} v 0) v1 -- 0x7f35fc0b3a80 con 0x7f35fc0a9950 2023-08-09T14:15:10.360 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.359+0000 7f35f2ffd700 1 -- 172.21.15.101:0/1826634380 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35ec025680 con 0x7f35fc0a9950 2023-08-09T14:15:10.361 INFO:teuthology.orchestra.run.smithi101.stdout:6 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 msgr2=0x7f35fc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35ec016000 tx=0x7f35ec001980 comp rx=0 tx=0).stop 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 shutdown_connections 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35fc0a9dd0 0x7f35fc0b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35e8004850 0x7f35fc1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.362 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 --2- 172.21.15.101:0/1826634380 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35fc0a9950 0x7f35fc0b1890 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.363 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 >> 172.21.15.101:0/1826634380 conn(0x7f35fc0cecb0 msgr2=0x7f35fc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.363 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 shutdown_connections 2023-08-09T14:15:10.363 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.360+0000 7f36047a8700 1 -- 172.21.15.101:0/1826634380 wait complete. 2023-08-09T14:15:10.373 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 11296481-9850-4980-adf4-bc61eebe2a14 7 2023-08-09T14:15:10.482 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:10.480+0000 7f020f2ac200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-09T14:15:10.498 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.496+0000 7f0141f8d700 1 Processor -- start 2023-08-09T14:15:10.498 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.496+0000 7f0141f8d700 1 -- start start 2023-08-09T14:15:10.500 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f0141f8d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 0x7f013c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.500 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f0141f8d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0715a0 con 0x7f013c15d3a0 2023-08-09T14:15:10.500 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f0141f8d700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0712a0 con 0x7f013c0cd1c0 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f0141f8d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0cd6c0 con 0x7f013c06a8d0 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013affd700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f013c0cd1c0 0x7f013c06a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.101:57274/0 (socket says 172.21.15.101:57274) 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013affd700 1 -- 172.21.15.101:0/2495558853 learned_addr learned my addr 172.21.15.101:0/2495558853 (peer_addr_for_me v1:172.21.15.101:0/0) 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013bfff700 1 --2- 172.21.15.101:0/2495558853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 0x7f013c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013a7fc700 1 -- 172.21.15.101:0/2495558853 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641454018 0 0) 0x7f013c0712a0 con 0x7f013c0cd1c0 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013bfff700 1 -- 172.21.15.101:0/2495558853 >> v1:172.21.15.101:6789/0 conn(0x7f013c0cd1c0 legacy=0x7f013c06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.501 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013bfff700 1 -- 172.21.15.101:0/2495558853 >> v1:172.21.15.5:6789/0 conn(0x7f013c15d3a0 legacy=0x7f013c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013bfff700 1 -- 172.21.15.101:0/2495558853 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0ce110 con 0x7f013c06a8d0 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013bfff700 1 --2- 172.21.15.101:0/2495558853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 0x7f013c0af2c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0134009dc0 tx=0x7f013400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6d723663163d46 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.497+0000 7f013a7fc700 1 -- 172.21.15.101:0/2495558853 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400e070 con 0x7f013c06a8d0 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f013a7fc700 1 -- 172.21.15.101:0/2495558853 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400bbd0 con 0x7f013c06a8d0 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f013a7fc700 1 -- 172.21.15.101:0/2495558853 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134012430 con 0x7f013c06a8d0 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 -- 172.21.15.101:0/2495558853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 msgr2=0x7f013c0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2495558853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 0x7f013c0af2c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0134009dc0 tx=0x7f013400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:10.502 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 -- 172.21.15.101:0/2495558853 shutdown_connections 2023-08-09T14:15:10.503 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2495558853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c06a8d0 0x7f013c0af2c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.503 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 -- 172.21.15.101:0/2495558853 >> 172.21.15.101:0/2495558853 conn(0x7f013c0b1970 msgr2=0x7f013c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.503 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 -- 172.21.15.101:0/2495558853 shutdown_connections 2023-08-09T14:15:10.503 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.498+0000 7f0141f8d700 1 -- 172.21.15.101:0/2495558853 wait complete. 2023-08-09T14:15:10.505 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.499+0000 7f0141f8d700 1 Processor -- start 2023-08-09T14:15:10.505 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 -- start start 2023-08-09T14:15:10.505 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f013c06a8d0 0x7f013c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f013c0cd1c0 0x7f013c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1f3df0 con 0x7f013c0cd1c0 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0b5830 con 0x7f013c06a8d0 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f0141f8d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0c4b30 con 0x7f013c15d3a0 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f013bfff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f013b7fe700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f013c06a8d0 0x7f013c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.506 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f013bfff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.101:40736/0 (socket says 172.21.15.101:40736) 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f013bfff700 1 -- 172.21.15.101:0/2432862723 learned_addr learned my addr 172.21.15.101:0/2432862723 (peer_addr_for_me v2:172.21.15.101:0/0) 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.500+0000 7f013affd700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f013c0cd1c0 0x7f013c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 -- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f013c06a8d0 msgr2=0x7f013c1f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f013c06a8d0 0x7f013c1f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 -- 172.21.15.101:0/2432862723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f013c0cd1c0 msgr2=0x7f013c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f013c0cd1c0 0x7f013c0b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.507 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 -- 172.21.15.101:0/2432862723 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134009a70 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f013bfff700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0134014040 tx=0x7f0134004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013401b810 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134020070 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c0c4e10 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013401bb90 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0c53d0 con 0x7f013c15d3a0 2023-08-09T14:15:10.508 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0134027480 con 0x7f013c15d3a0 2023-08-09T14:15:10.509 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.501+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0134022070 con 0x7f013c15d3a0 2023-08-09T14:15:10.509 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.502+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c074600 con 0x7f013c15d3a0 2023-08-09T14:15:10.509 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.504+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f013401cc50 con 0x7f013c15d3a0 2023-08-09T14:15:10.525 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:10.524+0000 7ff44bda9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-09T14:15:10.554 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:10.553+0000 7f020f2ac200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-09T14:15:10.589 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.587+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11296481-9850-4980-adf4-bc61eebe2a14", "id": 7} v 0) v1 -- 0x7f013c0cfb80 con 0x7f013c15d3a0 2023-08-09T14:15:10.594 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.592+0000 7f0123fff700 1 -- 172.21.15.101:0/2432862723 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11296481-9850-4980-adf4-bc61eebe2a14", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0134027910 con 0x7f013c15d3a0 2023-08-09T14:15:10.594 INFO:teuthology.orchestra.run.smithi101.stdout:7 2023-08-09T14:15:10.596 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 msgr2=0x7f013c159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.596 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0134014040 tx=0x7f0134004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.596 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 shutdown_connections 2023-08-09T14:15:10.596 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f013c15d3a0 0x7f013c159cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.597 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f013c06a8d0 0x7f013c1f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.597 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 --2- 172.21.15.101:0/2432862723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f013c0cd1c0 0x7f013c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.597 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 >> 172.21.15.101:0/2432862723 conn(0x7f013c0b1970 msgr2=0x7f013c0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.598 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 shutdown_connections 2023-08-09T14:15:10.598 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-09T14:15:10.593+0000 7f0141f8d700 1 -- 172.21.15.101:0/2432862723 wait complete. 2023-08-09T14:15:10.599 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:10.595+0000 7ff44bda9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-09T14:15:10.607 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-09T14:15:10.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-09T14:15:10.610 INFO:tasks.ceph.osd.0:Started 2023-08-09T14:15:10.611 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-09T14:15:10.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-09T14:15:10.613 INFO:tasks.ceph.osd.1:Started 2023-08-09T14:15:10.614 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-09T14:15:10.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-09T14:15:10.616 INFO:tasks.ceph.osd.2:Started 2023-08-09T14:15:10.617 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-09T14:15:10.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-09T14:15:10.619 INFO:tasks.ceph.osd.3:Started 2023-08-09T14:15:10.619 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-09T14:15:10.620 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-09T14:15:10.622 INFO:tasks.ceph.osd.4:Started 2023-08-09T14:15:10.622 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-09T14:15:10.622 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-09T14:15:10.624 INFO:tasks.ceph.osd.5:Started 2023-08-09T14:15:10.624 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-09T14:15:10.625 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-09T14:15:10.626 INFO:tasks.ceph.osd.6:Started 2023-08-09T14:15:10.626 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-09T14:15:10.627 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-09T14:15:10.628 INFO:tasks.ceph.osd.7:Started 2023-08-09T14:15:10.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.786+0000 7f62fb11e700 1 Processor -- start 2023-08-09T14:15:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.786+0000 7f62fb11e700 1 -- start start 2023-08-09T14:15:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62fb11e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 0x7f62f40b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62fb11e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40cd880 con 0x7f62f415b1e0 2023-08-09T14:15:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62fb11e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40d1e50 con 0x7f62f40b2f90 2023-08-09T14:15:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62fb11e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b3420 con 0x7f62f40cb590 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62f8eba700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62f415b1e0 0x7f62f40cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55416/0 (socket says 172.21.15.5:55416) 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62f8eba700 1 -- 172.21.15.5:0/667737774 learned_addr learned my addr 172.21.15.5:0/667737774 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62f3fff700 1 --2- 172.21.15.5:0/667737774 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 0x7f62f40b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939093025 0 0) 0x7f62f40cd880 con 0x7f62f415b1e0 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.787+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e40035b0 con 0x7f62f415b1e0 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935550478 0 0) 0x7f62f40d1e50 con 0x7f62f40b2f90 2023-08-09T14:15:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f40cd880 con 0x7f62f40b2f90 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f3fff700 1 -- 172.21.15.5:0/667737774 >> v1:172.21.15.101:6789/0 conn(0x7f62f40b2f90 legacy=0x7f62f415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f3fff700 1 -- 172.21.15.5:0/667737774 >> v1:172.21.15.5:6789/0 conn(0x7f62f415b1e0 legacy=0x7f62f40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f3fff700 1 -- 172.21.15.5:0/667737774 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f406f7e0 con 0x7f62f40cb590 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f3fff700 1 --2- 172.21.15.5:0/667737774 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 0x7f62f40b2a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009870 tx=0x7f62e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c50a28a727c08fe0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011830 con 0x7f62f40cb590 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0011990 con 0x7f62f40cb590 2023-08-09T14:15:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62f37fe700 1 -- 172.21.15.5:0/667737774 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011d20 con 0x7f62f40cb590 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62fb11e700 1 -- 172.21.15.5:0/667737774 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 msgr2=0x7f62f40b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62fb11e700 1 --2- 172.21.15.5:0/667737774 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 0x7f62f40b2a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009870 tx=0x7f62e0009b80 comp rx=0 tx=0).stop 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62fb11e700 1 -- 172.21.15.5:0/667737774 shutdown_connections 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.788+0000 7f62fb11e700 1 --2- 172.21.15.5:0/667737774 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f40cb590 0x7f62f40b2a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.789+0000 7f62fb11e700 1 -- 172.21.15.5:0/667737774 >> 172.21.15.5:0/667737774 conn(0x7f62f40d0fd0 msgr2=0x7f62f40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.789+0000 7f62fb11e700 1 -- 172.21.15.5:0/667737774 shutdown_connections 2023-08-09T14:15:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.789+0000 7f62fb11e700 1 -- 172.21.15.5:0/667737774 wait complete. 2023-08-09T14:15:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.790+0000 7f62fb11e700 1 Processor -- start 2023-08-09T14:15:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.790+0000 7f62fb11e700 1 -- start start 2023-08-09T14:15:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f62f40b2f90 0x7f62f40a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f415b1e0 0x7f62f4149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f4148230 con 0x7f62f40cb590 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f414a7b0 con 0x7f62f40b2f90 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62fb11e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f414aa90 con 0x7f62f415b1e0 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42008/0 (socket says 172.21.15.5:42008) 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 -- 172.21.15.5:0/1236579127 learned_addr learned my addr 172.21.15.5:0/1236579127 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f8eba700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f62f40b2f90 0x7f62f40a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f96bb700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f415b1e0 0x7f62f4149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 -- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f415b1e0 msgr2=0x7f62f4149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f415b1e0 0x7f62f4149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 -- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f62f40b2f90 msgr2=0x7f62f40a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f62f40b2f90 0x7f62f40a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 -- 172.21.15.5:0/1236579127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00094a0 con 0x7f62f40cb590 2023-08-09T14:15:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f3fff700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62e00090b0 tx=0x7f62e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e001a6e0 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e001a840 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.791+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e001abb0 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.792+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f414ad70 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.792+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f41f0580 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.792+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62e0022070 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.792+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f62e001ad10 con 0x7f62f40cb590 2023-08-09T14:15:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.792+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f41483a0 con 0x7f62f40cb590 2023-08-09T14:15:10.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.795+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f62e0032060 con 0x7f62f40cb590 2023-08-09T14:15:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.866+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62f4074600 con 0x7f62f40cb590 2023-08-09T14:15:10.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.866+0000 7f62f17fa700 1 -- 172.21.15.5:0/1236579127 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f62e0029070 con 0x7f62f40cb590 2023-08-09T14:15:10.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:10.869 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:10.589330+0000","last_up_change":"0.000000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 msgr2=0x7f62f41f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62e00090b0 tx=0x7f62e0004750 comp rx=0 tx=0).stop 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 shutdown_connections 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f62f415b1e0 0x7f62f4149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f62f40b2f90 0x7f62f40a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 --2- 172.21.15.5:0/1236579127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40cb590 0x7f62f41f0040 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 >> 172.21.15.5:0/1236579127 conn(0x7f62f40d0fd0 msgr2=0x7f62f4159710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 shutdown_connections 2023-08-09T14:15:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:10.867+0000 7f62fb11e700 1 -- 172.21.15.5:0/1236579127 wait complete. 2023-08-09T14:15:10.881 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-09T14:15:10.881 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-09T14:15:11.232 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:15:11.230+0000 7ff15e81e640 -1 Falling back to public interface 2023-08-09T14:15:11.236 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:15:11.234+0000 7f5c49bea640 -1 Falling back to public interface 2023-08-09T14:15:11.245 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:15:11.243+0000 7f70f2fda640 -1 Falling back to public interface 2023-08-09T14:15:11.246 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:15:11.244+0000 7f0c8f471640 -1 Falling back to public interface 2023-08-09T14:15:11.246 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:15:11.245+0000 7f70ea398700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2023-08-09T14:15:11.250 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:15:11.249+0000 7f80399df640 -1 Falling back to public interface 2023-08-09T14:15:11.254 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:15:11.253+0000 7f2e8c68a640 -1 Falling back to public interface 2023-08-09T14:15:11.255 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:15:11.254+0000 7ffb18e6f640 -1 Falling back to public interface 2023-08-09T14:15:11.255 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:15:11.254+0000 7f2e83a48700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2023-08-09T14:15:11.260 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:15:11.259+0000 7fddf3eee640 -1 Falling back to public interface 2023-08-09T14:15:11.270 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:11.268+0000 7f020f2ac200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-09T14:15:11.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:11.344+0000 7f020f2ac200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-09T14:15:11.362 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:11.361+0000 7ff44bda9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-09T14:15:11.443 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:11.442+0000 7ff44bda9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-09T14:15:11.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:11.483+0000 7f020f2ac200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-09T14:15:11.590 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:11.589+0000 7ff44bda9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-09T14:15:11.686 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:11.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:11.717+0000 7f020f2ac200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-09T14:15:11.802 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.800+0000 7f773c1be700 1 Processor -- start 2023-08-09T14:15:11.802 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.800+0000 7f773c1be700 1 -- start start 2023-08-09T14:15:11.805 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f773c1be700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f773406a8d0 0x7f77340b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:11.805 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f773c1be700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77340cf2a0 con 0x7f77340af500 2023-08-09T14:15:11.805 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f773c1be700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7734071670 con 0x7f773415d1e0 2023-08-09T14:15:11.806 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f773c1be700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7734161680 con 0x7f773406a8d0 2023-08-09T14:15:11.806 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f7739759700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f77340af500 0x7f773406a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55430/0 (socket says 172.21.15.5:55430) 2023-08-09T14:15:11.806 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f7739759700 1 -- 172.21.15.5:0/473908808 learned_addr learned my addr 172.21.15.5:0/473908808 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:11.807 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.801+0000 7f773a75b700 1 --2- 172.21.15.5:0/473908808 >> v2:172.21.15.101:3300/0 conn(0x7f773406a8d0 0x7f77340b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:11.807 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083541860 0 0) 0x7f77340cf2a0 con 0x7f77340af500 2023-08-09T14:15:11.807 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f771c0035b0 con 0x7f77340af500 2023-08-09T14:15:11.807 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932094194 0 0) 0x7f7734071670 con 0x7f773415d1e0 2023-08-09T14:15:11.808 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77340cf2a0 con 0x7f773415d1e0 2023-08-09T14:15:11.808 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f773a75b700 1 -- 172.21.15.5:0/473908808 >> v1:172.21.15.101:6789/0 conn(0x7f773415d1e0 legacy=0x7f7734160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.808 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f773a75b700 1 -- 172.21.15.5:0/473908808 >> v1:172.21.15.5:6789/0 conn(0x7f77340af500 legacy=0x7f773406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.808 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f773a75b700 1 -- 172.21.15.5:0/473908808 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77340cf4d0 con 0x7f773406a8d0 2023-08-09T14:15:11.809 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f773a75b700 1 --2- 172.21.15.5:0/473908808 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773406a8d0 0x7f77340b1d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f772c0098a0 tx=0x7f772c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd1327be14e6b0e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:11.809 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c011830 con 0x7f773406a8d0 2023-08-09T14:15:11.809 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c011990 con 0x7f773406a8d0 2023-08-09T14:15:11.809 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.802+0000 7f7738f58700 1 -- 172.21.15.5:0/473908808 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c011d20 con 0x7f773406a8d0 2023-08-09T14:15:11.810 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 -- 172.21.15.5:0/473908808 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773406a8d0 msgr2=0x7f77340b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.810 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 --2- 172.21.15.5:0/473908808 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773406a8d0 0x7f77340b1d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f772c0098a0 tx=0x7f772c009bb0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.810 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 -- 172.21.15.5:0/473908808 shutdown_connections 2023-08-09T14:15:11.811 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 --2- 172.21.15.5:0/473908808 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773406a8d0 0x7f77340b1d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.811 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 -- 172.21.15.5:0/473908808 >> 172.21.15.5:0/473908808 conn(0x7f77340cc990 msgr2=0x7f77340ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:11.811 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 -- 172.21.15.5:0/473908808 shutdown_connections 2023-08-09T14:15:11.811 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.803+0000 7f773c1be700 1 -- 172.21.15.5:0/473908808 wait complete. 2023-08-09T14:15:11.815 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.804+0000 7f773c1be700 1 Processor -- start 2023-08-09T14:15:11.816 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.804+0000 7f773c1be700 1 -- start start 2023-08-09T14:15:11.816 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:11.817 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f77340af500 0x7f77341e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:11.817 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 0x7f773414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:11.818 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340c6250 con 0x7f773406a8d0 2023-08-09T14:15:11.818 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340c5640 con 0x7f773415d1e0 2023-08-09T14:15:11.818 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773c1be700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77340c5920 con 0x7f77340af500 2023-08-09T14:15:11.819 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f7739f5a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:11.819 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f7739f5a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42018/0 (socket says 172.21.15.5:42018) 2023-08-09T14:15:11.820 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f7739f5a700 1 -- 172.21.15.5:0/2634641810 learned_addr learned my addr 172.21.15.5:0/2634641810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:11.820 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f773a75b700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 0x7f773414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:11.821 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.805+0000 7f7739759700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f77340af500 0x7f77341e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:11.821 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 -- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f77340af500 msgr2=0x7f77341e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.822 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f77340af500 0x7f77341e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.822 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 -- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 msgr2=0x7f773414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.823 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 0x7f773414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.823 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 -- 172.21.15.5:0/2634641810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0094a0 con 0x7f773406a8d0 2023-08-09T14:15:11.823 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f773a75b700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 0x7f773414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:11.823 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f7739f5a700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7724001f30 tx=0x7f7724002240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:11.823 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724003c50 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724003db0 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77340c5c00 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ab00 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773415c620 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77240050d0 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.806+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7724012cd0 con 0x7f773406a8d0 2023-08-09T14:15:11.824 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.807+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77340b17b0 con 0x7f773406a8d0 2023-08-09T14:15:11.825 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.809+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7724005560 con 0x7f773406a8d0 2023-08-09T14:15:11.839 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:11.838+0000 7ff44bda9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-09T14:15:11.881 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.880+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7734074640 con 0x7f773406a8d0 2023-08-09T14:15:11.881 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.880+0000 7f77327fc700 1 -- 172.21.15.5:0/2634641810 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7724005700 con 0x7f773406a8d0 2023-08-09T14:15:11.882 INFO:teuthology.misc.health.smithi005.stdout: 2023-08-09T14:15:11.882 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:10.589330+0000","last_up_change":"0.000000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:11.883 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 msgr2=0x7f773415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:11.883 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7724001f30 tx=0x7f7724002240 comp rx=0 tx=0).stop 2023-08-09T14:15:11.883 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 shutdown_connections 2023-08-09T14:15:11.883 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f773415d1e0 0x7f773414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.884 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f773406a8d0 0x7f773415de70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.884 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 --2- 172.21.15.5:0/2634641810 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f77340af500 0x7f77341e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:11.884 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 >> 172.21.15.5:0/2634641810 conn(0x7f77340cc990 msgr2=0x7f77340b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:11.884 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 shutdown_connections 2023-08-09T14:15:11.884 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:11.881+0000 7f773c1be700 1 -- 172.21.15.5:0/2634641810 wait complete. 2023-08-09T14:15:11.893 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-09T14:15:11.929 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:11.928+0000 7f020f2ac200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-09T14:15:12.060 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.058+0000 7f020f2ac200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-09T14:15:12.061 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:12.060+0000 7ff44bda9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-09T14:15:12.201 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:12.200+0000 7ff44bda9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-09T14:15:12.279 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.277+0000 7f020f2ac200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-09T14:15:12.429 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:12.428+0000 7ff44bda9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-09T14:15:12.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.433+0000 7f020f2ac200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-09T14:15:12.547 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.545+0000 7f020f2ac200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-09T14:15:12.591 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:12.590+0000 7ff44bda9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-09T14:15:12.711 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:12.710+0000 7ff44bda9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-09T14:15:12.870 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.868+0000 7f020f2ac200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-09T14:15:12.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:12.969+0000 7f020f2ac200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-09T14:15:13.047 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:13.046+0000 7ff44bda9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-09T14:15:13.151 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:13.149+0000 7ff44bda9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-09T14:15:13.154 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:13.152+0000 7f020f2ac200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-09T14:15:13.344 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:13.343+0000 7ff44bda9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-09T14:15:13.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:13.756+0000 7f020f2ac200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-09T14:15:14.002 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-08-09T14:15:14.001+0000 7ff44bda9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-09T14:15:14.526 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:15:14.525+0000 7fddf3eee640 -1 osd.2 0 log_to_monitors true 2023-08-09T14:15:14.728 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:15:14.727+0000 7ffb18e6f640 -1 osd.1 0 log_to_monitors true 2023-08-09T14:15:14.760 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:15:14.759+0000 7f2e8c68a640 -1 osd.3 0 log_to_monitors true 2023-08-09T14:15:14.765 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:15:14.764+0000 7f80399df640 -1 osd.0 0 log_to_monitors true 2023-08-09T14:15:14.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:14.786+0000 7f01c72c0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-09T14:15:14.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2023-08-09T14:15:14.788+0000 7f01c72c0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-09T14:15:14.808 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:15:14.806+0000 7ff15e81e640 -1 osd.5 0 log_to_monitors true 2023-08-09T14:15:14.809 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:15:14.808+0000 7f70f2fda640 -1 osd.4 0 log_to_monitors true 2023-08-09T14:15:14.820 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:15:14.818+0000 7f0c8f471640 -1 osd.7 0 log_to_monitors true 2023-08-09T14:15:14.823 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:15:14.821+0000 7f5c49bea640 -1 osd.6 0 log_to_monitors true 2023-08-09T14:15:17.240 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:15:17.239+0000 7f802d596700 -1 osd.0 0 waiting for initial osdmap 2023-08-09T14:15:17.254 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:15:17.253+0000 7f2e80241700 -1 osd.3 0 waiting for initial osdmap 2023-08-09T14:15:17.258 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:15:17.257+0000 7f8025971700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.265 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:15:17.264+0000 7f2e7861c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.270 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:15:17.269+0000 7fdde7aa5700 -1 osd.2 0 waiting for initial osdmap 2023-08-09T14:15:17.284 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:15:17.283+0000 7fdddfe80700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.292 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:15:17.291+0000 7ffb0ca26700 -1 osd.1 0 waiting for initial osdmap 2023-08-09T14:15:17.304 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:15:17.303+0000 7ffb04e01700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.930 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:15:17.928+0000 7f0c83028700 -1 osd.7 0 waiting for initial osdmap 2023-08-09T14:15:17.933 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:15:17.931+0000 7f5c3d7a1700 -1 osd.6 0 waiting for initial osdmap 2023-08-09T14:15:17.945 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:15:17.944+0000 7f0c7b403700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.949 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:15:17.948+0000 7f5c35b7c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:15:17.958+0000 7ff1523d5700 -1 osd.5 0 waiting for initial osdmap 2023-08-09T14:15:17.960 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:15:17.958+0000 7f70e6b91700 -1 osd.4 0 waiting for initial osdmap 2023-08-09T14:15:17.968 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:15:17.967+0000 7f70def6c700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:17.973 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:15:17.972+0000 7ff14a7b0700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T14:15:18.700 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:18.829 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.827+0000 7f66ceb60700 1 Processor -- start 2023-08-09T14:15:18.829 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.827+0000 7f66ceb60700 1 -- start start 2023-08-09T14:15:18.836 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66ceb60700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.836 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66ceb60700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.836 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66ceb60700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c815ed50 con 0x7f66c806d3a0 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66ceb60700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c815f6f0 con 0x7f66c815c1b0 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66ceb60700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c815f030 con 0x7f66c80cb0b0 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66cd0fd700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66cd0fd700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59208/0 (socket says 172.21.15.5:59208) 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66cc8fc700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f66c806d3a0 0x7f66c80ca9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:36922/0 (socket says 172.21.15.5:36922) 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:59976/0 (socket says 172.21.15.5:59976) 2023-08-09T14:15:18.837 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.828+0000 7f66cd0fd700 1 -- 172.21.15.5:0/3976959021 learned_addr learned my addr 172.21.15.5:0/3976959021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c7fff700 1 -- 172.21.15.5:0/3976959021 >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 msgr2=0x7f66c806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c7fff700 1 --2- 172.21.15.5:0/3976959021 >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c7fff700 1 -- 172.21.15.5:0/3976959021 >> v1:172.21.15.101:6789/0 conn(0x7f66c806d3a0 legacy=0x7f66c80ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c7fff700 1 -- 172.21.15.5:0/3976959021 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c815f310 con 0x7f66c80cb0b0 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c77fe700 1 -- 172.21.15.5:0/3976959021 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139783446 0 0) 0x7f66c815ed50 con 0x7f66c806d3a0 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66cd0fd700 1 --2- 172.21.15.5:0/3976959021 >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:18.838 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c7fff700 1 --2- 172.21.15.5:0/3976959021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009840 tx=0x7f66b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83126841ceadf96c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c77fe700 1 -- 172.21.15.5:0/3976959021 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011830 con 0x7f66c80cb0b0 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c77fe700 1 -- 172.21.15.5:0/3976959021 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4011990 con 0x7f66c80cb0b0 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.829+0000 7f66c77fe700 1 -- 172.21.15.5:0/3976959021 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011d20 con 0x7f66c80cb0b0 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 -- 172.21.15.5:0/3976959021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 msgr2=0x7f66c806fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 --2- 172.21.15.5:0/3976959021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009840 tx=0x7f66b4009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 -- 172.21.15.5:0/3976959021 shutdown_connections 2023-08-09T14:15:18.839 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 --2- 172.21.15.5:0/3976959021 >> v2:172.21.15.101:3300/0 conn(0x7f66c815c1b0 0x7f66c806bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 --2- 172.21.15.5:0/3976959021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c80cb0b0 0x7f66c806fd10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 -- 172.21.15.5:0/3976959021 >> 172.21.15.5:0/3976959021 conn(0x7f66c80ced90 msgr2=0x7f66c80cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 -- 172.21.15.5:0/3976959021 shutdown_connections 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.830+0000 7f66ceb60700 1 -- 172.21.15.5:0/3976959021 wait complete. 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.831+0000 7f66ceb60700 1 Processor -- start 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.831+0000 7f66ceb60700 1 -- start start 2023-08-09T14:15:18.840 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f66c80cb0b0 0x7f66c80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c815c1b0 0x7f66c80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c814d340 con 0x7f66c806d3a0 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80ccff0 con 0x7f66c80cb0b0 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66ceb60700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80cd2d0 con 0x7f66c815c1b0 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42166/0 (socket says 172.21.15.5:42166) 2023-08-09T14:15:18.841 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 -- 172.21.15.5:0/2378317465 learned_addr learned my addr 172.21.15.5:0/2378317465 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cd0fd700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c815c1b0 0x7f66c80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66c7fff700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f66c80cb0b0 0x7f66c80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 -- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c815c1b0 msgr2=0x7f66c80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c815c1b0 0x7f66c80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 -- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f66c80cb0b0 msgr2=0x7f66c80c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f66c80cb0b0 0x7f66c80c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:18.842 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 -- 172.21.15.5:0/2378317465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009b30 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.832+0000 7f66cc8fc700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0011e0 tx=0x7f66bc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.833+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc004c80 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.833+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc004e00 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.833+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40094a0 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.833+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc007310 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.833+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80cd890 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.834+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c815faf0 con 0x7f66c806d3a0 2023-08-09T14:15:18.843 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.834+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f66bc007470 con 0x7f66c806d3a0 2023-08-09T14:15:18.844 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.835+0000 7f66c57fa700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 0x7f66ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:18.844 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.835+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3631+0+0 (secure 0 0 0) 0x7f66bc087710 con 0x7f66c806d3a0 2023-08-09T14:15:18.844 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.835+0000 7f66c7fff700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 0x7f66ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:18.844 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.835+0000 7f66c7fff700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 0x7f66ac06c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66b40090b0 tx=0x7f66b4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:18.845 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:18.839+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f66c815faf0 con 0x7f66c806d3a0 2023-08-09T14:15:19.043 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.042+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c815faf0 con 0x7f66c806d3a0 2023-08-09T14:15:19.044 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.043+0000 7f66c57fa700 1 -- 172.21.15.5:0/2378317465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10975 (secure 0 0 0) 0x7f66c815faf0 con 0x7f66c806d3a0 2023-08-09T14:15:19.044 INFO:teuthology.misc.health.smithi005.stdout: 2023-08-09T14:15:19.045 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":14,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:18.950651+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 msgr2=0x7f66ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 0x7f66ac06c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66b40090b0 tx=0x7f66b4008030 comp rx=0 tx=0).stop 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 msgr2=0x7f66c8145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0011e0 tx=0x7f66bc00ca30 comp rx=0 tx=0).stop 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 shutdown_connections 2023-08-09T14:15:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f66ac06a050 0x7f66ac06c510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f66c815c1b0 0x7f66c80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c806d3a0 0x7f66c8145190 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 --2- 172.21.15.5:0/2378317465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f66c80cb0b0 0x7f66c80c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 >> 172.21.15.5:0/2378317465 conn(0x7f66c80ced90 msgr2=0x7f66c8155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 shutdown_connections 2023-08-09T14:15:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-08-09T14:15:19.045+0000 7f66ceb60700 1 -- 172.21.15.5:0/2378317465 wait complete. 2023-08-09T14:15:19.064 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-09T14:15:19.064 INFO:tasks.ceph:Creating RBD pool 2023-08-09T14:15:19.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-09T14:15:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.190+0000 7feb1b3f6700 1 Processor -- start 2023-08-09T14:15:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.190+0000 7feb1b3f6700 1 -- start start 2023-08-09T14:15:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.190+0000 7feb1b3f6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb140b4b90 0x7feb1406a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb1b3f6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140cd990 con 0x7feb140cc650 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb1b3f6700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140b53e0 con 0x7feb14066160 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb1b3f6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1406c5a0 con 0x7feb140b4b90 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb18991700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb140b4b90 0x7feb1406a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb19192700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb140cc650 0x7feb1406be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55610/0 (socket says 172.21.15.5:55610) 2023-08-09T14:15:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb19192700 1 -- 172.21.15.5:0/2979948416 learned_addr learned my addr 172.21.15.5:0/2979948416 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb18991700 1 -- 172.21.15.5:0/2979948416 >> v1:172.21.15.101:6789/0 conn(0x7feb14066160 legacy=0x7feb140ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb18991700 1 -- 172.21.15.5:0/2979948416 >> v1:172.21.15.5:6789/0 conn(0x7feb140cc650 legacy=0x7feb1406be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb18991700 1 -- 172.21.15.5:0/2979948416 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140b5100 con 0x7feb140b4b90 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb07fff700 1 -- 172.21.15.5:0/2979948416 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734415087 0 0) 0x7feb140cd990 con 0x7feb140cc650 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb18991700 1 --2- 172.21.15.5:0/2979948416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb140b4b90 0x7feb1406a1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb08009840 tx=0x7feb08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff1de57e0b3aca2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb07fff700 1 -- 172.21.15.5:0/2979948416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011830 con 0x7feb140b4b90 2023-08-09T14:15:19.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb07fff700 1 -- 172.21.15.5:0/2979948416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08011990 con 0x7feb140b4b90 2023-08-09T14:15:19.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.191+0000 7feb07fff700 1 -- 172.21.15.5:0/2979948416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011d20 con 0x7feb140b4b90 2023-08-09T14:15:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 -- 172.21.15.5:0/2979948416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb140b4b90 msgr2=0x7feb1406a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/2979948416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb140b4b90 0x7feb1406a1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb08009840 tx=0x7feb08009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 -- 172.21.15.5:0/2979948416 shutdown_connections 2023-08-09T14:15:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/2979948416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb140b4b90 0x7feb1406a1c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 -- 172.21.15.5:0/2979948416 >> 172.21.15.5:0/2979948416 conn(0x7feb140cf4d0 msgr2=0x7feb140cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 -- 172.21.15.5:0/2979948416 shutdown_connections 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.192+0000 7feb1b3f6700 1 -- 172.21.15.5:0/2979948416 wait complete. 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.193+0000 7feb1b3f6700 1 Processor -- start 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.193+0000 7feb1b3f6700 1 -- start start 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feb140b4b90 0x7feb1409a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 0x7feb140b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140adee0 con 0x7feb14066160 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140ae1c0 con 0x7feb140b4b90 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb1b3f6700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c30a0 con 0x7feb140cc650 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42200/0 (socket says 172.21.15.5:42200) 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 -- 172.21.15.5:0/1060253377 learned_addr learned my addr 172.21.15.5:0/1060253377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb18991700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feb140b4b90 0x7feb1409a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19993700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 0x7feb140b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 -- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 msgr2=0x7feb140b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 0x7feb140b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 -- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feb140b4b90 msgr2=0x7feb1409a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feb140b4b90 0x7feb1409a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19192700 1 -- 172.21.15.5:0/1060253377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080094a0 con 0x7feb14066160 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.194+0000 7feb19993700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 0x7feb140b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb19192700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c470 tx=0x7feb1000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100074e0 con 0x7feb14066160 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10007640 con 0x7feb14066160 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10005a70 con 0x7feb14066160 2023-08-09T14:15:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140c3380 con 0x7feb14066160 2023-08-09T14:15:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.195+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1409ab10 con 0x7feb14066160 2023-08-09T14:15:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.196+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1409aca0 con 0x7feb14066160 2023-08-09T14:15:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.196+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7feb10005bd0 con 0x7feb14066160 2023-08-09T14:15:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.197+0000 7feb05ffb700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 0x7feaf806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.197+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7feb100871a0 con 0x7feb14066160 2023-08-09T14:15:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.197+0000 7feb18991700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 0x7feaf806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.198+0000 7feb18991700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 0x7feaf806c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb080090b0 tx=0x7feb0801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.202+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feb10053030 con 0x7feb14066160 2023-08-09T14:15:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:19.408+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7feb14074600 con 0x7feb14066160 2023-08-09T14:15:20.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.314+0000 7feb05ffb700 1 -- 172.21.15.5:0/1060253377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7feb10056650 con 0x7feb14066160 2023-08-09T14:15:20.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 msgr2=0x7feaf806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 0x7feaf806c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb080090b0 tx=0x7feb0801c040 comp rx=0 tx=0).stop 2023-08-09T14:15:20.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 msgr2=0x7feb1415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c470 tx=0x7feb1000c780 comp rx=0 tx=0).stop 2023-08-09T14:15:20.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 shutdown_connections 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feaf806a050 0x7feaf806c510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feb140cc650 0x7feb140b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb14066160 0x7feb1415ba00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 --2- 172.21.15.5:0/1060253377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feb140b4b90 0x7feb1409a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 >> 172.21.15.5:0/1060253377 conn(0x7feb140cf4d0 msgr2=0x7feb14160760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:20.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 shutdown_connections 2023-08-09T14:15:20.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.318+0000 7feb1b3f6700 1 -- 172.21.15.5:0/1060253377 wait complete. 2023-08-09T14:15:20.323 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2023-08-09T14:15:20.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-09T14:15:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.466+0000 7f98a02df700 1 Processor -- start 2023-08-09T14:15:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.466+0000 7f98a02df700 1 -- start start 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f98a02df700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f989815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f98a02df700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98980ccfd0 0x7f98980caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f98a02df700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98980cab00 con 0x7f989806d5c0 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f98a02df700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989815ea10 con 0x7f98980ccfd0 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f98a02df700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980cc690 con 0x7f989815d330 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98980ccfd0 0x7f98980caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989d87a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f989806d5c0 0x7f98980cc8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55690/0 (socket says 172.21.15.5:55690) 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98980ccfd0 0x7f98980caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42276/0 (socket says 172.21.15.5:42276) 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989d87a700 1 -- 172.21.15.5:0/3674469299 learned_addr learned my addr 172.21.15.5:0/3674469299 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e07b700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f989815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 -- 172.21.15.5:0/3674469299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 msgr2=0x7f989815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f989815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 -- 172.21.15.5:0/3674469299 >> v1:172.21.15.5:6789/0 conn(0x7f989806d5c0 legacy=0x7f98980cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989e87c700 1 -- 172.21.15.5:0/3674469299 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989806e640 con 0x7f98980ccfd0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.467+0000 7f989d079700 1 -- 172.21.15.5:0/3674469299 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789828581 0 0) 0x7f98980cab00 con 0x7f989806d5c0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f989e87c700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f98980caf30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344ce0c0f53c73bc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f989d079700 1 -- 172.21.15.5:0/3674469299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000e070 con 0x7f98980ccfd0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f989d079700 1 -- 172.21.15.5:0/3674469299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989000bbd0 con 0x7f98980ccfd0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f989d079700 1 -- 172.21.15.5:0/3674469299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012430 con 0x7f98980ccfd0 2023-08-09T14:15:20.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 -- 172.21.15.5:0/3674469299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 msgr2=0x7f98980caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f98980caf30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 -- 172.21.15.5:0/3674469299 shutdown_connections 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f98980caf30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 --2- 172.21.15.5:0/3674469299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f989815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 -- 172.21.15.5:0/3674469299 >> 172.21.15.5:0/3674469299 conn(0x7f98980b1a20 msgr2=0x7f98980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 -- 172.21.15.5:0/3674469299 shutdown_connections 2023-08-09T14:15:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.468+0000 7f98a02df700 1 -- 172.21.15.5:0/3674469299 wait complete. 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.469+0000 7f98a02df700 1 Processor -- start 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 -- start start 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 0x7f989814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f98980c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989814f1a0 con 0x7f98980ccfd0 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989814f440 con 0x7f989806d5c0 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f98a02df700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989814f720 con 0x7f989815d330 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f989d87a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f989d87a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42280/0 (socket says 172.21.15.5:42280) 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f989d87a700 1 -- 172.21.15.5:0/2695079828 learned_addr learned my addr 172.21.15.5:0/2695079828 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f989e07b700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 0x7f989814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.470+0000 7f989e87c700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f98980c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 -- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 msgr2=0x7f98980c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f98980c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 -- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 msgr2=0x7f989814a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 0x7f989814a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 -- 172.21.15.5:0/2695079828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009a70 con 0x7f98980ccfd0 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989e87c700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f98980c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989e07b700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 0x7f989814a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f989d87a700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f98940011e0 tx=0x7f989400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894004c80 con 0x7f98980ccfd0 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894004e00 con 0x7f98980ccfd0 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989814fa00 con 0x7f98980ccfd0 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894007310 con 0x7f98980ccfd0 2023-08-09T14:15:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.471+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98980aea20 con 0x7f98980ccfd0 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.472+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980aec40 con 0x7f98980ccfd0 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.473+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9894007470 con 0x7f98980ccfd0 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.473+0000 7f988effd700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 0x7f987c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.473+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f9894087e70 con 0x7f98980ccfd0 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.473+0000 7f989e07b700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 0x7f987c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.474+0000 7f989e07b700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 0x7f987c06c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9888007a50 tx=0x7f9888008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.478+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f98940539a0 con 0x7f98980ccfd0 2023-08-09T14:15:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:20.678+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9898074600 con 0x7f98980ccfd0 2023-08-09T14:15:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.324+0000 7f988effd700 1 -- 172.21.15.5:0/2695079828 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9894056fc0 con 0x7f98980ccfd0 2023-08-09T14:15:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 msgr2=0x7f987c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 0x7f987c06c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9888007a50 tx=0x7f9888008040 comp rx=0 tx=0).stop 2023-08-09T14:15:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 msgr2=0x7f989814adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f98940011e0 tx=0x7f989400cae0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 shutdown_connections 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f987c06a050 0x7f987c06c510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f989815d330 0x7f98980c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f989806d5c0 0x7f989814a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 --2- 172.21.15.5:0/2695079828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980ccfd0 0x7f989814adc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.327+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 >> 172.21.15.5:0/2695079828 conn(0x7f98980b1a20 msgr2=0x7f98980cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:21.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.328+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 shutdown_connections 2023-08-09T14:15:21.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.328+0000 7f98a02df700 1 -- 172.21.15.5:0/2695079828 wait complete. 2023-08-09T14:15:21.331 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-09T14:15:21.345 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-09T14:15:21.346 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T14:15:21.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T14:15:21.349 INFO:tasks.ceph.mds.a:Started 2023-08-09T14:15:21.350 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T14:15:21.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T14:15:21.355 INFO:tasks.ceph.mds.c:Started 2023-08-09T14:15:21.356 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T14:15:21.356 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T14:15:21.360 INFO:tasks.ceph.mds.b:Started 2023-08-09T14:15:21.360 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T14:15:21.360 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T14:15:21.363 INFO:tasks.ceph.mds.d:Started 2023-08-09T14:15:21.364 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-09T14:15:21.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:21.444 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-08-09T14:15:21.447 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-08-09T14:15:21.448 INFO:tasks.ceph.mds.b.smithi101.stdout:starting mds.b at 2023-08-09T14:15:21.453 INFO:tasks.ceph.mds.d.smithi101.stdout:starting mds.d at 2023-08-09T14:15:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.509+0000 7f88dee8c700 1 Processor -- start 2023-08-09T14:15:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.509+0000 7f88dee8c700 1 -- start start 2023-08-09T14:15:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dee8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88d8154600 0x7f88d815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dee8c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f88d815b360 0x7f88d815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dee8c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d815eb20 con 0x7f88d80ce410 2023-08-09T14:15:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dee8c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d806d4f0 con 0x7f88d8154600 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dee8c700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d815e560 con 0x7f88d815b360 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dcc28700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88d8154600 0x7f88d815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dcc28700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88d8154600 0x7f88d815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42314/0 (socket says 172.21.15.5:42314) 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88dcc28700 1 -- 172.21.15.5:0/316812567 learned_addr learned my addr 172.21.15.5:0/316812567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.510+0000 7f88d7fff700 1 --2- 172.21.15.5:0/316812567 >> v2:172.21.15.101:3300/0 conn(0x7f88d815b360 0x7f88d815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88dcc28700 1 -- 172.21.15.5:0/316812567 >> v2:172.21.15.101:3300/0 conn(0x7f88d815b360 msgr2=0x7f88d815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:21.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88dcc28700 1 --2- 172.21.15.5:0/316812567 >> v2:172.21.15.101:3300/0 conn(0x7f88d815b360 0x7f88d815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88dcc28700 1 -- 172.21.15.5:0/316812567 >> v1:172.21.15.101:6789/0 conn(0x7f88d80ce410 legacy=0x7f88d806dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88dcc28700 1 -- 172.21.15.5:0/316812567 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d815e840 con 0x7f88d8154600 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88dcc28700 1 --2- 172.21.15.5:0/316812567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d8154600 0x7f88d815b790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88d8071df0 tx=0x7f88cc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51302bcd9e582bc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88d77fe700 1 -- 172.21.15.5:0/316812567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00dc70 con 0x7f88d8154600 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88d77fe700 1 -- 172.21.15.5:0/316812567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00ddd0 con 0x7f88d8154600 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.511+0000 7f88d77fe700 1 -- 172.21.15.5:0/316812567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc010690 con 0x7f88d8154600 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 -- 172.21.15.5:0/316812567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d8154600 msgr2=0x7f88d815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 --2- 172.21.15.5:0/316812567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d8154600 0x7f88d815b790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88d8071df0 tx=0x7f88cc00be70 comp rx=0 tx=0).stop 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 -- 172.21.15.5:0/316812567 shutdown_connections 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 --2- 172.21.15.5:0/316812567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d8154600 0x7f88d815b790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 --2- 172.21.15.5:0/316812567 >> v2:172.21.15.101:3300/0 conn(0x7f88d815b360 0x7f88d815dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 -- 172.21.15.5:0/316812567 >> 172.21.15.5:0/316812567 conn(0x7f88d80b1900 msgr2=0x7f88d80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 -- 172.21.15.5:0/316812567 shutdown_connections 2023-08-09T14:15:21.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.512+0000 7f88dee8c700 1 -- 172.21.15.5:0/316812567 wait complete. 2023-08-09T14:15:21.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.513+0000 7f88dee8c700 1 Processor -- start 2023-08-09T14:15:21.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.513+0000 7f88dee8c700 1 -- start start 2023-08-09T14:15:21.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 0x7f88d80b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 0x7f88d814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80c5100 con 0x7f88d815b360 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814d790 con 0x7f88d8154600 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dee8c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814cef0 con 0x7f88d80ce410 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2023-08-09T14:15:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dcc28700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 0x7f88d80b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 -- 172.21.15.5:0/2068075407 learned_addr learned my addr 172.21.15.5:0/2068075407 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88d7fff700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 0x7f88d814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 -- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 msgr2=0x7f88d80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 0x7f88d80b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 -- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 msgr2=0x7f88d814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 0x7f88d814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dd429700 1 -- 172.21.15.5:0/2068075407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc00b7f0 con 0x7f88d815b360 2023-08-09T14:15:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88d7fff700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 0x7f88d814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.514+0000 7f88dcc28700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 0x7f88d80b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88dd429700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88d000cb50 tx=0x7f88d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0003c00 con 0x7f88d815b360 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0003d60 con 0x7f88d815b360 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000aa20 con 0x7f88d815b360 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d814d1d0 con 0x7f88d815b360 2023-08-09T14:15:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.515+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d80c5330 con 0x7f88d815b360 2023-08-09T14:15:21.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.516+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8074600 con 0x7f88d815b360 2023-08-09T14:15:21.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.516+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f88d000ab80 con 0x7f88d815b360 2023-08-09T14:15:21.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.517+0000 7f88d57fa700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 0x7f88bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.517+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f88d0087ff0 con 0x7f88d815b360 2023-08-09T14:15:21.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.517+0000 7f88dcc28700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 0x7f88bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.517+0000 7f88dcc28700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 0x7f88bc06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00beb0 tx=0x7f88cc020040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.522+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f88d00ba7b0 con 0x7f88d815b360 2023-08-09T14:15:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.734+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88d815bca0 con 0x7f88d815b360 2023-08-09T14:15:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.735+0000 7f88d57fa700 1 -- 172.21.15.5:0/2068075407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14557 (secure 0 0 0) 0x7f88d0053ba0 con 0x7f88d815b360 2023-08-09T14:15:21.737 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:21.737 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:21.312766+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 msgr2=0x7f88bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 0x7f88bc06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00beb0 tx=0x7f88cc020040 comp rx=0 tx=0).stop 2023-08-09T14:15:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 msgr2=0x7f88d80c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88d000cb50 tx=0x7f88d000ce60 comp rx=0 tx=0).stop 2023-08-09T14:15:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 shutdown_connections 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f88bc06a050 0x7f88bc06c510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88d815b360 0x7f88d80c2700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88d80ce410 0x7f88d80b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 --2- 172.21.15.5:0/2068075407 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88d8154600 0x7f88d814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 >> 172.21.15.5:0/2068075407 conn(0x7f88d80b1900 msgr2=0x7f88d815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.737+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 shutdown_connections 2023-08-09T14:15:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.738+0000 7f88dee8c700 1 -- 172.21.15.5:0/2068075407 wait complete. 2023-08-09T14:15:21.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:21.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.883+0000 7f8bc4123700 1 Processor -- start 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.883+0000 7f8bc4123700 1 -- start start 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc4123700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc1599d0 0x7f8bbc0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc4123700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc4123700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc06cf50 con 0x7f8bbc06cb20 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc4123700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc159ef0 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc4123700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0cd890 con 0x7f8bbc1599d0 2023-08-09T14:15:21.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42330/0 (socket says 172.21.15.5:42330) 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 -- 172.21.15.5:0/2504858373 learned_addr learned my addr 172.21.15.5:0/2504858373 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc1ebf700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc1599d0 0x7f8bbc0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 -- 172.21.15.5:0/2504858373 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc1599d0 msgr2=0x7f8bbc0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc1599d0 0x7f8bbc0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 -- 172.21.15.5:0/2504858373 >> v1:172.21.15.101:6789/0 conn(0x7f8bbc06cb20 legacy=0x7f8bbc15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 -- 172.21.15.5:0/2504858373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc15a160 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.884+0000 7f8bc16be700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0098f0 tx=0x7f8bac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51090cb98e21f3d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc0ebd700 1 -- 172.21.15.5:0/2504858373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac011830 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc0ebd700 1 -- 172.21.15.5:0/2504858373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac011990 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc0ebd700 1 -- 172.21.15.5:0/2504858373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac011d20 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 -- 172.21.15.5:0/2504858373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc0c9d00 msgr2=0x7f8bbc06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0098f0 tx=0x7f8bac009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 -- 172.21.15.5:0/2504858373 shutdown_connections 2023-08-09T14:15:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc1599d0 0x7f8bbc0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 --2- 172.21.15.5:0/2504858373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc06c5e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 -- 172.21.15.5:0/2504858373 >> 172.21.15.5:0/2504858373 conn(0x7f8bbc0cecb0 msgr2=0x7f8bbc0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 -- 172.21.15.5:0/2504858373 shutdown_connections 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.885+0000 7f8bc4123700 1 -- 172.21.15.5:0/2504858373 wait complete. 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.887+0000 7f8bc4123700 1 Processor -- start 2023-08-09T14:15:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.887+0000 7f8bc4123700 1 -- start start 2023-08-09T14:15:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc06cb20 0x7f8bbc0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc15bd10 con 0x7f8bbc1599d0 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0c5080 con 0x7f8bbc0c9d00 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc4123700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0c5360 con 0x7f8bbc06cb20 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42338/0 (socket says 172.21.15.5:42338) 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 -- 172.21.15.5:0/3161914285 learned_addr learned my addr 172.21.15.5:0/3161914285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc1ebf700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc06cb20 0x7f8bbc0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc16be700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 -- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc06cb20 msgr2=0x7f8bbc0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc06cb20 0x7f8bbc0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 -- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8bbc0c9d00 msgr2=0x7f8bbc145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 -- 172.21.15.5:0/3161914285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009550 con 0x7f8bbc1599d0 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.888+0000 7f8bc26c0700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400cc50 tx=0x7f8bb400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.889+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4003c00 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.889+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4003d60 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.889+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc15bf80 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.889+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400aab0 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.889+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc0c4ce0 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.890+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f8bb400ac10 con 0x7f8bbc1599d0 2023-08-09T14:15:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.890+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc15c170 con 0x7f8bbc1599d0 2023-08-09T14:15:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.890+0000 7f8bb27fc700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 0x7f8ba006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.891+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8bb4088130 con 0x7f8bbc1599d0 2023-08-09T14:15:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.891+0000 7f8bc1ebf700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 0x7f8ba006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.891+0000 7f8bc1ebf700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 0x7f8ba006c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009b40 tx=0x7f8bb8009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:21.895+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8bb4053bb0 con 0x7f8bbc1599d0 2023-08-09T14:15:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.101+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8bbc074600 con 0x7f8bbc1599d0 2023-08-09T14:15:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.101+0000 7f8bb27fc700 1 -- 172.21.15.5:0/3161914285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8bb40571d0 con 0x7f8bbc1599d0 2023-08-09T14:15:22.103 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 msgr2=0x7f8ba006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 0x7f8ba006c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009b40 tx=0x7f8bb8009210 comp rx=0 tx=0).stop 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 msgr2=0x7f8bbc0c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400cc50 tx=0x7f8bb400cf60 comp rx=0 tx=0).stop 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 shutdown_connections 2023-08-09T14:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8ba006a050 0x7f8ba006c510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bbc1599d0 0x7f8bbc0c6060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8bbc06cb20 0x7f8bbc0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 --2- 172.21.15.5:0/3161914285 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8bbc0c9d00 0x7f8bbc145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 >> 172.21.15.5:0/3161914285 conn(0x7f8bbc0cecb0 msgr2=0x7f8bbc06bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 shutdown_connections 2023-08-09T14:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.103+0000 7f8bc4123700 1 -- 172.21.15.5:0/3161914285 wait complete. 2023-08-09T14:15:22.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.244+0000 7f0b79e23700 1 Processor -- start 2023-08-09T14:15:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.245+0000 7f0b79e23700 1 -- start start 2023-08-09T14:15:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b79e23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b79e23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b740b2ff0 0x7f0b74151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b79e23700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b740cf500 con 0x7f0b740cb4b0 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b79e23700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7415fc90 con 0x7f0b740b2ff0 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b79e23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740cf990 con 0x7f0b740b6170 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b72ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b740cb4b0 0x7f0b740b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55760/0 (socket says 172.21.15.5:55760) 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b72ffd700 1 -- 172.21.15.5:0/3063361790 learned_addr learned my addr 172.21.15.5:0/3063361790 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b73fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b740b2ff0 0x7f0b74151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b737fe700 1 --2- 172.21.15.5:0/3063361790 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b737fe700 1 -- 172.21.15.5:0/3063361790 >> v2:172.21.15.5:3300/0 conn(0x7f0b740b2ff0 msgr2=0x7f0b74151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b737fe700 1 --2- 172.21.15.5:0/3063361790 >> v2:172.21.15.5:3300/0 conn(0x7f0b740b2ff0 0x7f0b74151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b737fe700 1 -- 172.21.15.5:0/3063361790 >> v1:172.21.15.5:6789/0 conn(0x7f0b740cb4b0 legacy=0x7f0b740b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.246+0000 7f0b737fe700 1 -- 172.21.15.5:0/3063361790 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740cb930 con 0x7f0b740b6170 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b737fe700 1 --2- 172.21.15.5:0/3063361790 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=307e23eb90d8999d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b727fc700 1 -- 172.21.15.5:0/3063361790 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00e070 con 0x7f0b740b6170 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b727fc700 1 -- 172.21.15.5:0/3063361790 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00bb20 con 0x7f0b740b6170 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b727fc700 1 -- 172.21.15.5:0/3063361790 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c012430 con 0x7f0b740b6170 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 -- 172.21.15.5:0/3063361790 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 msgr2=0x7f0b7415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 --2- 172.21.15.5:0/3063361790 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 -- 172.21.15.5:0/3063361790 shutdown_connections 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 --2- 172.21.15.5:0/3063361790 >> v2:172.21.15.5:3300/0 conn(0x7f0b740b2ff0 0x7f0b74151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 --2- 172.21.15.5:0/3063361790 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415f640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 -- 172.21.15.5:0/3063361790 >> 172.21.15.5:0/3063361790 conn(0x7f0b7406dec0 msgr2=0x7f0b7406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 -- 172.21.15.5:0/3063361790 shutdown_connections 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.247+0000 7f0b79e23700 1 -- 172.21.15.5:0/3063361790 wait complete. 2023-08-09T14:15:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.248+0000 7f0b79e23700 1 Processor -- start 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 -- start start 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 0x7f0b740c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b741f38e0 con 0x7f0b740cb4b0 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b741f2d60 con 0x7f0b740b2ff0 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.249+0000 7f0b79e23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b741f3040 con 0x7f0b740b6170 2023-08-09T14:15:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b73fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b73fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42352/0 (socket says 172.21.15.5:42352) 2023-08-09T14:15:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b73fff700 1 -- 172.21.15.5:0/1716423093 learned_addr learned my addr 172.21.15.5:0/1716423093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 0x7f0b740c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b72ffd700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 -- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 msgr2=0x7f0b7415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 -- 172.21.15.5:0/1716423093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 msgr2=0x7f0b740c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 -- 172.21.15.5:0/1716423093 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c009a70 con 0x7f0b740b2ff0 2023-08-09T14:15:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b73fff700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b72ffd700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b737fe700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 0x7f0b740c5e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c012430 con 0x7f0b740b2ff0 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c020070 con 0x7f0b740b2ff0 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004280 con 0x7f0b740b2ff0 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b741f3320 con 0x7f0b740b2ff0 2023-08-09T14:15:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.250+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b741f2950 con 0x7f0b740b2ff0 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.251+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b741f3180 con 0x7f0b740b2ff0 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.252+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f0b6c0043e0 con 0x7f0b740b2ff0 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.252+0000 7f0b6bfff700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 0x7f0b5406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.252+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b6c022070 con 0x7f0b740b2ff0 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.252+0000 7f0b72ffd700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 0x7f0b5406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.253+0000 7f0b72ffd700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 0x7f0b5406c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c005910 tx=0x7f0b5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.257+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0b741f3180 con 0x7f0b740b2ff0 2023-08-09T14:15:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.456+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b7406b360 con 0x7f0b740b2ff0 2023-08-09T14:15:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.457+0000 7f0b6bfff700 1 -- 172.21.15.5:0/1716423093 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b6c02c020 con 0x7f0b740b2ff0 2023-08-09T14:15:22.458 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.458+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 msgr2=0x7f0b5406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.458+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 0x7f0b5406c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c005910 tx=0x7f0b5c009040 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 msgr2=0x7f0b740c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 0x7f0b740c5e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 shutdown_connections 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0b5406a050 0x7f0b5406c510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b740cb4b0 0x7f0b740c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0b740b2ff0 0x7f0b740c5e30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 --2- 172.21.15.5:0/1716423093 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0b740b6170 0x7f0b7415a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 >> 172.21.15.5:0/1716423093 conn(0x7f0b7406dec0 msgr2=0x7f0b740b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 shutdown_connections 2023-08-09T14:15:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.459+0000 7f0b79e23700 1 -- 172.21.15.5:0/1716423093 wait complete. 2023-08-09T14:15:22.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:15:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.596+0000 7f98da752700 1 Processor -- start 2023-08-09T14:15:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 -- start start 2023-08-09T14:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98d4154600 0x7f98d415b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 0x7f98d40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40cee00 con 0x7f98d415b360 2023-08-09T14:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d415eb20 con 0x7f98d4154600 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98da752700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d415e2d0 con 0x7f98d40ce410 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.597+0000 7f98d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98d4154600 0x7f98d415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98d4154600 0x7f98d415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42358/0 (socket says 172.21.15.5:42358) 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 -- 172.21.15.5:0/3675570097 learned_addr learned my addr 172.21.15.5:0/3675570097 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d8cef700 1 --2- 172.21.15.5:0/3675570097 >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 0x7f98d40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 -- 172.21.15.5:0/3675570097 >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 msgr2=0x7f98d40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 --2- 172.21.15.5:0/3675570097 >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 0x7f98d40ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 -- 172.21.15.5:0/3675570097 >> v1:172.21.15.101:6789/0 conn(0x7f98d415b360 legacy=0x7f98d415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 -- 172.21.15.5:0/3675570097 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d406d4f0 con 0x7f98d4154600 2023-08-09T14:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d8cef700 1 --2- 172.21.15.5:0/3675570097 >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 0x7f98d40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d3fff700 1 --2- 172.21.15.5:0/3675570097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d4154600 0x7f98d415b790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d40ca810 tx=0x7f98c400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f013717b5a1315 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d2ffd700 1 -- 172.21.15.5:0/3675570097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400dcf0 con 0x7f98d4154600 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d2ffd700 1 -- 172.21.15.5:0/3675570097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400de50 con 0x7f98d4154600 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.598+0000 7f98d2ffd700 1 -- 172.21.15.5:0/3675570097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4004250 con 0x7f98d4154600 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 -- 172.21.15.5:0/3675570097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d4154600 msgr2=0x7f98d415b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 --2- 172.21.15.5:0/3675570097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d4154600 0x7f98d415b790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d40ca810 tx=0x7f98c400be70 comp rx=0 tx=0).stop 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 -- 172.21.15.5:0/3675570097 shutdown_connections 2023-08-09T14:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 --2- 172.21.15.5:0/3675570097 >> v2:172.21.15.101:3300/0 conn(0x7f98d40ce410 0x7f98d40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 --2- 172.21.15.5:0/3675570097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d4154600 0x7f98d415b790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 -- 172.21.15.5:0/3675570097 >> 172.21.15.5:0/3675570097 conn(0x7f98d40b1900 msgr2=0x7f98d40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 -- 172.21.15.5:0/3675570097 shutdown_connections 2023-08-09T14:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.599+0000 7f98da752700 1 -- 172.21.15.5:0/3675570097 wait complete. 2023-08-09T14:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.600+0000 7f98da752700 1 Processor -- start 2023-08-09T14:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.600+0000 7f98da752700 1 -- start start 2023-08-09T14:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98d40ce410 0x7f98d41f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d4154600 0x7f98d40c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c9da0 con 0x7f98d415b360 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40ccc00 con 0x7f98d40ce410 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98da752700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c87c0 con 0x7f98d4154600 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42368/0 (socket says 172.21.15.5:42368) 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 -- 172.21.15.5:0/215311015 learned_addr learned my addr 172.21.15.5:0/215311015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d3fff700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98d40ce410 0x7f98d41f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d37fe700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d4154600 0x7f98d40c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 -- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d4154600 msgr2=0x7f98d40c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d4154600 0x7f98d40c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 -- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98d40ce410 msgr2=0x7f98d41f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98d40ce410 0x7f98d41f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 -- 172.21.15.5:0/215311015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c400b7f0 con 0x7f98d415b360 2023-08-09T14:15:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.601+0000 7f98d8cef700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00cef0 tx=0x7f98cc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.602+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00ad00 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.602+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00ae60 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.602+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d40c8aa0 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.602+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc015680 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.602+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d40c9060 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.603+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d4074600 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.603+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f98cc00d430 con 0x7f98d415b360 2023-08-09T14:15:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.603+0000 7f98d0ff9700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 0x7f98c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.604+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f98cc0884e0 con 0x7f98d415b360 2023-08-09T14:15:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.604+0000 7f98d3fff700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 0x7f98c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.604+0000 7f98d3fff700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 0x7f98c006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f98c4000c00 tx=0x7f98c401d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.608+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f98cc054090 con 0x7f98d415b360 2023-08-09T14:15:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.618+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98cc054460 con 0x7f98d415b360 2023-08-09T14:15:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.857+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98d40c9f90 con 0x7f98d415b360 2023-08-09T14:15:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.858+0000 7f98d0ff9700 1 -- 172.21.15.5:0/215311015 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f98cc01ae80 con 0x7f98d415b360 2023-08-09T14:15:22.861 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:22.861 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-09T14:15:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 msgr2=0x7f98c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 0x7f98c006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f98c4000c00 tx=0x7f98c401d040 comp rx=0 tx=0).stop 2023-08-09T14:15:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 msgr2=0x7f98d40cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00cef0 tx=0x7f98cc00cf20 comp rx=0 tx=0).stop 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 shutdown_connections 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98c006a050 0x7f98c006c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d415b360 0x7f98d40cc6c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98d40ce410 0x7f98d41f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 --2- 172.21.15.5:0/215311015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d4154600 0x7f98d40c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 >> 172.21.15.5:0/215311015 conn(0x7f98d40b1900 msgr2=0x7f98d415c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 shutdown_connections 2023-08-09T14:15:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.860+0000 7f98da752700 1 -- 172.21.15.5:0/215311015 wait complete. 2023-08-09T14:15:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-08-09T14:15:22.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.997+0000 7f351c33a700 1 Processor -- start 2023-08-09T14:15:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.997+0000 7f351c33a700 1 -- start start 2023-08-09T14:15:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351c33a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f3514071170 0x7f35140b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351c33a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351406e4c0 con 0x7f351415b020 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351c33a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140cc170 con 0x7f351406a8d0 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351c33a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351406eb60 con 0x7f3514071170 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a0d6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f351415b020 0x7f351406a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55788/0 (socket says 172.21.15.5:55788) 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a0d6700 1 -- 172.21.15.5:0/244323776 learned_addr learned my addr 172.21.15.5:0/244323776 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a8d7700 1 --2- 172.21.15.5:0/244323776 >> v2:172.21.15.101:3300/0 conn(0x7f3514071170 0x7f35140b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40348382 0 0) 0x7f351406e4c0 con 0x7f351415b020 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35000035b0 con 0x7f351415b020 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98841145 0 0) 0x7f35140cc170 con 0x7f351406a8d0 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351406e4c0 con 0x7f351406a8d0 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a8d7700 1 -- 172.21.15.5:0/244323776 >> v1:172.21.15.101:6789/0 conn(0x7f351406a8d0 legacy=0x7f35140b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a8d7700 1 -- 172.21.15.5:0/244323776 >> v1:172.21.15.5:6789/0 conn(0x7f351415b020 legacy=0x7f351406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a8d7700 1 -- 172.21.15.5:0/244323776 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140cc450 con 0x7f3514071170 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.998+0000 7f351a8d7700 1 --2- 172.21.15.5:0/244323776 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f35140b34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f350c009d90 tx=0x7f350c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cd4ae83aaca6aa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00e070 con 0x7f3514071170 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00bb20 con 0x7f3514071170 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f35190d4700 1 -- 172.21.15.5:0/244323776 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c012430 con 0x7f3514071170 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 -- 172.21.15.5:0/244323776 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 msgr2=0x7f35140b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 --2- 172.21.15.5:0/244323776 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f35140b34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f350c009d90 tx=0x7f350c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 -- 172.21.15.5:0/244323776 shutdown_connections 2023-08-09T14:15:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 --2- 172.21.15.5:0/244323776 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f35140b34c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 -- 172.21.15.5:0/244323776 >> 172.21.15.5:0/244323776 conn(0x7f35140b1900 msgr2=0x7f35140b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 -- 172.21.15.5:0/244323776 shutdown_connections 2023-08-09T14:15:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:22.999+0000 7f351c33a700 1 -- 172.21.15.5:0/244323776 wait complete. 2023-08-09T14:15:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.000+0000 7f351c33a700 1 Processor -- start 2023-08-09T14:15:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.000+0000 7f351c33a700 1 -- start start 2023-08-09T14:15:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f351406a8d0 0x7f351415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f3514158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c4c50 con 0x7f351415b020 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c6e40 con 0x7f3514071170 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351c33a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514158960 con 0x7f351406a8d0 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351a8d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351a8d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42382/0 (socket says 172.21.15.5:42382) 2023-08-09T14:15:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351a0d6700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f351406a8d0 0x7f351415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f351a8d7700 1 -- 172.21.15.5:0/322782461 learned_addr learned my addr 172.21.15.5:0/322782461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.001+0000 7f35198d5700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f3514158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 -- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f351406a8d0 msgr2=0x7f351415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f351406a8d0 0x7f351415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 -- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 msgr2=0x7f3514158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f3514158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 -- 172.21.15.5:0/322782461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009a70 con 0x7f351415b020 2023-08-09T14:15:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351a8d7700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35140b26f0 tx=0x7f350c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c012430 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c020070 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35140c9760 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c01ba50 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.002+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35140c9d20 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.003+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514074600 con 0x7f351415b020 2023-08-09T14:15:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.003+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f350c01bbb0 con 0x7f351415b020 2023-08-09T14:15:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.004+0000 7f350affd700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 0x7f34f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.004+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f350c022070 con 0x7f351415b020 2023-08-09T14:15:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.004+0000 7f351a0d6700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 0x7f34f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.004+0000 7f351a0d6700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 0x7f34f806c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3510007fd0 tx=0x7f3510007e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.008+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f350c055ed0 con 0x7f351415b020 2023-08-09T14:15:23.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.206+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35140b1190 con 0x7f351415b020 2023-08-09T14:15:23.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.207+0000 7f350affd700 1 -- 172.21.15.5:0/322782461 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f350c01be60 con 0x7f351415b020 2023-08-09T14:15:23.209 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:23.209 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:22.325325+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:23.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 msgr2=0x7f34f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 0x7f34f806c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3510007fd0 tx=0x7f3510007e00 comp rx=0 tx=0).stop 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 msgr2=0x7f35140b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35140b26f0 tx=0x7f350c004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 shutdown_connections 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f34f806a0e0 0x7f34f806c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f351415b020 0x7f35140b2db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f351406a8d0 0x7f351415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 --2- 172.21.15.5:0/322782461 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3514071170 0x7f3514158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 >> 172.21.15.5:0/322782461 conn(0x7f35140b1900 msgr2=0x7f351415a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 shutdown_connections 2023-08-09T14:15:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.209+0000 7f351c33a700 1 -- 172.21.15.5:0/322782461 wait complete. 2023-08-09T14:15:23.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:23.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.350+0000 7f633e27d700 1 Processor -- start 2023-08-09T14:15:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.350+0000 7f633e27d700 1 -- start start 2023-08-09T14:15:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f633e27d700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6338159e90 0x7f63380cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f633e27d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63380b2c70 0x7f633806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f633e27d700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63380cb2d0 con 0x7f63380ce410 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f633e27d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63380cb5b0 con 0x7f63380b2c70 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f633e27d700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63380cb890 con 0x7f6338159e90 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63380b2c70 0x7f633806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63380b2c70 0x7f633806db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42388/0 (socket says 172.21.15.5:42388) 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 -- 172.21.15.5:0/860812579 learned_addr learned my addr 172.21.15.5:0/860812579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f6337fff700 1 --2- 172.21.15.5:0/860812579 >> v2:172.21.15.101:3300/0 conn(0x7f6338159e90 0x7f63380cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 -- 172.21.15.5:0/860812579 >> v2:172.21.15.101:3300/0 conn(0x7f6338159e90 msgr2=0x7f63380cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 --2- 172.21.15.5:0/860812579 >> v2:172.21.15.101:3300/0 conn(0x7f6338159e90 0x7f63380cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 -- 172.21.15.5:0/860812579 >> v1:172.21.15.101:6789/0 conn(0x7f63380ce410 legacy=0x7f6338070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 -- 172.21.15.5:0/860812579 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380cbb70 con 0x7f63380b2c70 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.351+0000 7f63377fe700 1 --2- 172.21.15.5:0/860812579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380b2c70 0x7f633806db30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6338072a90 tx=0x7f6320009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c331e50ef4ae70d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f6336ffd700 1 -- 172.21.15.5:0/860812579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320011830 con 0x7f63380b2c70 2023-08-09T14:15:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f6336ffd700 1 -- 172.21.15.5:0/860812579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320011990 con 0x7f63380b2c70 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f6336ffd700 1 -- 172.21.15.5:0/860812579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320011d20 con 0x7f63380b2c70 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 -- 172.21.15.5:0/860812579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380b2c70 msgr2=0x7f633806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 --2- 172.21.15.5:0/860812579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380b2c70 0x7f633806db30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6338072a90 tx=0x7f6320009bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 -- 172.21.15.5:0/860812579 shutdown_connections 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 --2- 172.21.15.5:0/860812579 >> v2:172.21.15.101:3300/0 conn(0x7f6338159e90 0x7f63380cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 --2- 172.21.15.5:0/860812579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380b2c70 0x7f633806db30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 -- 172.21.15.5:0/860812579 >> 172.21.15.5:0/860812579 conn(0x7f63380b1970 msgr2=0x7f63380b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 -- 172.21.15.5:0/860812579 shutdown_connections 2023-08-09T14:15:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.352+0000 7f633e27d700 1 -- 172.21.15.5:0/860812579 wait complete. 2023-08-09T14:15:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.353+0000 7f633e27d700 1 Processor -- start 2023-08-09T14:15:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 -- start start 2023-08-09T14:15:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f63380b2c70 0x7f6338153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6338159e90 0x7f63380c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63380b42b0 con 0x7f63380ce410 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338153000 con 0x7f6338159e90 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f633e27d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63381532e0 con 0x7f63380b2c70 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.354+0000 7f63377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42394/0 (socket says 172.21.15.5:42394) 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 -- 172.21.15.5:0/1540820787 learned_addr learned my addr 172.21.15.5:0/1540820787 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f6337fff700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f63380b2c70 0x7f6338153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f633c81a700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6338159e90 0x7f63380c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 -- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f63380b2c70 msgr2=0x7f6338153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f63380b2c70 0x7f6338153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 -- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6338159e90 msgr2=0x7f63380c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6338159e90 0x7f63380c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 -- 172.21.15.5:0/1540820787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009550 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f63377fe700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6320009c10 tx=0x7f6320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320004510 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632001e070 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200038e0 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633814d7a0 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.355+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63380ca140 con 0x7f63380ce410 2023-08-09T14:15:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.356+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338153500 con 0x7f63380ce410 2023-08-09T14:15:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.357+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6320003a40 con 0x7f63380ce410 2023-08-09T14:15:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.357+0000 7f6334ff9700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 0x7f631806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.357+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6320088f80 con 0x7f63380ce410 2023-08-09T14:15:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.357+0000 7f6337fff700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 0x7f631806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.357+0000 7f6337fff700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 0x7f631806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f633806a630 tx=0x7f6328009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.361+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f63200bb7b0 con 0x7f63380ce410 2023-08-09T14:15:23.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.559+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6338152e30 con 0x7f63380ce410 2023-08-09T14:15:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.560+0000 7f6334ff9700 1 -- 172.21.15.5:0/1540820787 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63200200a0 con 0x7f63380ce410 2023-08-09T14:15:23.562 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.561+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 msgr2=0x7f631806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.561+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 0x7f631806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f633806a630 tx=0x7f6328009210 comp rx=0 tx=0).stop 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.561+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 msgr2=0x7f633814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.561+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6320009c10 tx=0x7f6320004750 comp rx=0 tx=0).stop 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 shutdown_connections 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f631806a0e0 0x7f631806c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6338159e90 0x7f63380c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f63380b2c70 0x7f6338153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 --2- 172.21.15.5:0/1540820787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63380ce410 0x7f633814d260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 >> 172.21.15.5:0/1540820787 conn(0x7f63380b1970 msgr2=0x7f63380b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 shutdown_connections 2023-08-09T14:15:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.562+0000 7f633e27d700 1 -- 172.21.15.5:0/1540820787 wait complete. 2023-08-09T14:15:23.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:23.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.701+0000 7f8059b78700 1 Processor -- start 2023-08-09T14:15:23.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 -- start start 2023-08-09T14:15:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 0x7f80540cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80540ca3f0 0x7f805406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80540ca850 con 0x7f805406d930 2023-08-09T14:15:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805406af60 con 0x7f80540ca3f0 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8059b78700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805406ddc0 con 0x7f805415b130 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8052ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80540ca3f0 0x7f805406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8053fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f805406d930 0x7f80540cc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55820/0 (socket says 172.21.15.5:55820) 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.702+0000 7f8053fff700 1 -- 172.21.15.5:0/3166098525 learned_addr learned my addr 172.21.15.5:0/3166098525 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80537fe700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 0x7f80540cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f8052ffd700 1 -- 172.21.15.5:0/3166098525 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 msgr2=0x7f80540cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f8052ffd700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 0x7f80540cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f8052ffd700 1 -- 172.21.15.5:0/3166098525 >> v1:172.21.15.5:6789/0 conn(0x7f805406d930 legacy=0x7f80540cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f8052ffd700 1 -- 172.21.15.5:0/3166098525 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805406a1c0 con 0x7f80540ca3f0 2023-08-09T14:15:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80527fc700 1 -- 172.21.15.5:0/3166098525 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083694465 0 0) 0x7f80540ca850 con 0x7f805406d930 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80537fe700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 0x7f80540cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f8052ffd700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f805406d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8048009840 tx=0x7f8048009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494bc6c5769fd75f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80527fc700 1 -- 172.21.15.5:0/3166098525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011830 con 0x7f80540ca3f0 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80527fc700 1 -- 172.21.15.5:0/3166098525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048011990 con 0x7f80540ca3f0 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.703+0000 7f80527fc700 1 -- 172.21.15.5:0/3166098525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011d20 con 0x7f80540ca3f0 2023-08-09T14:15:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 -- 172.21.15.5:0/3166098525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 msgr2=0x7f805406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f805406d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8048009840 tx=0x7f8048009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 -- 172.21.15.5:0/3166098525 shutdown_connections 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805415b130 0x7f80540cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 --2- 172.21.15.5:0/3166098525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f805406d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 -- 172.21.15.5:0/3166098525 >> 172.21.15.5:0/3166098525 conn(0x7f80540b1970 msgr2=0x7f80540b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 -- 172.21.15.5:0/3166098525 shutdown_connections 2023-08-09T14:15:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.704+0000 7f8059b78700 1 -- 172.21.15.5:0/3166098525 wait complete. 2023-08-09T14:15:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.705+0000 7f8059b78700 1 Processor -- start 2023-08-09T14:15:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.705+0000 7f8059b78700 1 -- start start 2023-08-09T14:15:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805406d930 0x7f805415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 0x7f80540b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805415bd60 con 0x7f80540ca3f0 2023-08-09T14:15:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805415c040 con 0x7f805415b130 2023-08-09T14:15:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8059b78700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805415c320 con 0x7f805406d930 2023-08-09T14:15:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42408/0 (socket says 172.21.15.5:42408) 2023-08-09T14:15:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 -- 172.21.15.5:0/3023495574 learned_addr learned my addr 172.21.15.5:0/3023495574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8053fff700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 0x7f80540b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f80537fe700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805406d930 0x7f805415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 -- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805406d930 msgr2=0x7f805415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805406d930 0x7f805415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 -- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 msgr2=0x7f80540b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 0x7f80540b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 -- 172.21.15.5:0/3023495574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480094a0 con 0x7f80540ca3f0 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8053fff700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 0x7f80540b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f8052ffd700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80480090b0 tx=0x7f8048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80480038a0 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.706+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804801f070 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.707+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805415c600 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.707+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048003c20 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.707+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805415ba50 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.707+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805415cb20 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.708+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f804801a430 con 0x7f80540ca3f0 2023-08-09T14:15:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.708+0000 7f803bfff700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 0x7f804006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.708+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8048021070 con 0x7f80540ca3f0 2023-08-09T14:15:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.708+0000 7f80537fe700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 0x7f804006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.709+0000 7f80537fe700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 0x7f804006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80540b4cd0 tx=0x7f8044008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.713+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f805415cb20 con 0x7f80540ca3f0 2023-08-09T14:15:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.912+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f805415cb20 con 0x7f80540ca3f0 2023-08-09T14:15:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.913+0000 7f803bfff700 1 -- 172.21.15.5:0/3023495574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f805415cb20 con 0x7f80540ca3f0 2023-08-09T14:15:23.915 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 msgr2=0x7f804006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 0x7f804006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80540b4cd0 tx=0x7f8044008040 comp rx=0 tx=0).stop 2023-08-09T14:15:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 msgr2=0x7f8054149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80480090b0 tx=0x7f8048004750 comp rx=0 tx=0).stop 2023-08-09T14:15:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 shutdown_connections 2023-08-09T14:15:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f804006a0e0 0x7f804006c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f805415b130 0x7f80540b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f805406d930 0x7f805415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 --2- 172.21.15.5:0/3023495574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80540ca3f0 0x7f8054149010 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 >> 172.21.15.5:0/3023495574 conn(0x7f80540b1970 msgr2=0x7f8054070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 shutdown_connections 2023-08-09T14:15:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:23.915+0000 7f8059b78700 1 -- 172.21.15.5:0/3023495574 wait complete. 2023-08-09T14:15:23.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T14:15:24.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 Processor -- start 2023-08-09T14:15:24.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 -- start start 2023-08-09T14:15:24.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f483006a1c0 0x7f483006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483006e850 con 0x7f483006cd50 2023-08-09T14:15:24.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.052+0000 7f48355bf700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483006ab80 con 0x7f483006a1c0 2023-08-09T14:15:24.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f48355bf700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48300cf7b0 con 0x7f483015d400 2023-08-09T14:15:24.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482effd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f483006a1c0 0x7f483006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482f7fe700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f483006cd50 0x7f483006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37180/0 (socket says 172.21.15.5:37180) 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482effd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60228/0 (socket says 172.21.15.5:60228) 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482f7fe700 1 -- 172.21.15.5:0/3327815763 learned_addr learned my addr 172.21.15.5:0/3327815763 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 -- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 msgr2=0x7f48300cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 -- 172.21.15.5:0/3327815763 >> v1:172.21.15.101:6789/0 conn(0x7f483006cd50 legacy=0x7f483006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 -- 172.21.15.5:0/3327815763 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300cfa90 con 0x7f483006a1c0 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482effd700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482e7fc700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483006a1c0 0x7f483006a640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4824009870 tx=0x7f4824009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ffd263d09e70ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.053+0000 7f482dffb700 1 -- 172.21.15.5:0/3327815763 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824011830 con 0x7f483006a1c0 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f482dffb700 1 -- 172.21.15.5:0/3327815763 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824011990 con 0x7f483006a1c0 2023-08-09T14:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f482dffb700 1 -- 172.21.15.5:0/3327815763 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824011d20 con 0x7f483006a1c0 2023-08-09T14:15:24.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 -- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483006a1c0 msgr2=0x7f483006a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483006a1c0 0x7f483006a640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4824009870 tx=0x7f4824009b80 comp rx=0 tx=0).stop 2023-08-09T14:15:24.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 -- 172.21.15.5:0/3327815763 shutdown_connections 2023-08-09T14:15:24.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483015d400 0x7f48300cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 --2- 172.21.15.5:0/3327815763 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483006a1c0 0x7f483006a640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 -- 172.21.15.5:0/3327815763 >> 172.21.15.5:0/3327815763 conn(0x7f48300b1900 msgr2=0x7f48300b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 -- 172.21.15.5:0/3327815763 shutdown_connections 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.054+0000 7f48355bf700 1 -- 172.21.15.5:0/3327815763 wait complete. 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.055+0000 7f48355bf700 1 Processor -- start 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.055+0000 7f48355bf700 1 -- start start 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483006a1c0 0x7f4830155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483015d400 0x7f483006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830156a70 con 0x7f483006cd50 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830156d50 con 0x7f483015d400 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f48355bf700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830157030 con 0x7f483006a1c0 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f482e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f482f7fe700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483015d400 0x7f483006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f482e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42422/0 (socket says 172.21.15.5:42422) 2023-08-09T14:15:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f482e7fc700 1 -- 172.21.15.5:0/1589269914 learned_addr learned my addr 172.21.15.5:0/1589269914 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.056+0000 7f482effd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483006a1c0 0x7f4830155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 -- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483006a1c0 msgr2=0x7f4830155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483006a1c0 0x7f4830155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 -- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483015d400 msgr2=0x7f483006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483015d400 0x7f483006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 -- 172.21.15.5:0/1589269914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200094a0 con 0x7f483006cd50 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f482e7fc700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4824014040 tx=0x7f4824004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240036a0 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482401e070 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240094a0 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824003a20 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.057+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48301576f0 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.058+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4830074600 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.058+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4824003b80 con 0x7f483006cd50 2023-08-09T14:15:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.059+0000 7f48177fe700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 0x7f481c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.059+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4824089090 con 0x7f483006cd50 2023-08-09T14:15:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.059+0000 7f482effd700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 0x7f481c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.059+0000 7f482effd700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 0x7f481c06c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4820009d70 tx=0x7f4820009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.063+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4824054b60 con 0x7f483006cd50 2023-08-09T14:15:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.264+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4830071530 con 0x7f483006cd50 2023-08-09T14:15:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.264+0000 7f48177fe700 1 -- 172.21.15.5:0/1589269914 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4824020090 con 0x7f483006cd50 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-08-09T14:15:24.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:15:24.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:15:24.268 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-08-09T14:15:24.268 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-08-09T14:15:24.268 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:15:24.268 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-08-09T14:15:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 msgr2=0x7f481c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 0x7f481c06c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4820009d70 tx=0x7f4820009210 comp rx=0 tx=0).stop 2023-08-09T14:15:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 msgr2=0x7f4830159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4824014040 tx=0x7f4824004750 comp rx=0 tx=0).stop 2023-08-09T14:15:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 shutdown_connections 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f481c06a0e0 0x7f481c06c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f483015d400 0x7f483006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f483006a1c0 0x7f4830155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 --2- 172.21.15.5:0/1589269914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483006cd50 0x7f4830159550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 >> 172.21.15.5:0/1589269914 conn(0x7f48300b1900 msgr2=0x7f483015c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 shutdown_connections 2023-08-09T14:15:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.266+0000 7f48355bf700 1 -- 172.21.15.5:0/1589269914 wait complete. 2023-08-09T14:15:24.280 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T14:15:24.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T14:15:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.408+0000 7f60c896d700 1 Processor -- start 2023-08-09T14:15:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.408+0000 7f60c896d700 1 -- start start 2023-08-09T14:15:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c896d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60c415adc0 0x7f60c406a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c896d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c415f7d0 0x7f60c406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c896d700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c40cd510 con 0x7f60c40cc8d0 2023-08-09T14:15:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c896d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c40cd7f0 con 0x7f60c415adc0 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c896d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4071f00 con 0x7f60c415f7d0 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60c415adc0 0x7f60c406a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60c415adc0 0x7f60c406a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42428/0 (socket says 172.21.15.5:42428) 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 -- 172.21.15.5:0/3636451441 learned_addr learned my addr 172.21.15.5:0/3636451441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c1d9b700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c415f7d0 0x7f60c406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 -- 172.21.15.5:0/3636451441 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c415f7d0 msgr2=0x7f60c406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c415f7d0 0x7f60c406a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 -- 172.21.15.5:0/3636451441 >> v1:172.21.15.101:6789/0 conn(0x7f60c40cc8d0 legacy=0x7f60c40ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.409+0000 7f60c259c700 1 -- 172.21.15.5:0/3636451441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c415ecf0 con 0x7f60c415adc0 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c259c700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415adc0 0x7f60c406a1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098f0 tx=0x7f60b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deaf3b600a24d9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c159a700 1 -- 172.21.15.5:0/3636451441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800b8a0 con 0x7f60c415adc0 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c159a700 1 -- 172.21.15.5:0/3636451441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800ba00 con 0x7f60c415adc0 2023-08-09T14:15:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c159a700 1 -- 172.21.15.5:0/3636451441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800bd90 con 0x7f60c415adc0 2023-08-09T14:15:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 -- 172.21.15.5:0/3636451441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415adc0 msgr2=0x7f60c406a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415adc0 0x7f60c406a1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098f0 tx=0x7f60b8009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 -- 172.21.15.5:0/3636451441 shutdown_connections 2023-08-09T14:15:24.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415adc0 0x7f60c406a1c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 --2- 172.21.15.5:0/3636451441 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c415f7d0 0x7f60c406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 -- 172.21.15.5:0/3636451441 >> 172.21.15.5:0/3636451441 conn(0x7f60c40b1a20 msgr2=0x7f60c40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:24.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 -- 172.21.15.5:0/3636451441 shutdown_connections 2023-08-09T14:15:24.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.410+0000 7f60c896d700 1 -- 172.21.15.5:0/3636451441 wait complete. 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.412+0000 7f60c896d700 1 Processor -- start 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.412+0000 7f60c896d700 1 -- start start 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c40cc8d0 0x7f60c4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60c415adc0 0x7f60c41f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40c5c00 con 0x7f60c415f7d0 2023-08-09T14:15:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40c40c0 con 0x7f60c415adc0 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c41f1910 con 0x7f60c40cc8d0 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42438/0 (socket says 172.21.15.5:42438) 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 -- 172.21.15.5:0/3031687105 learned_addr learned my addr 172.21.15.5:0/3031687105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c1d9b700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60c415adc0 0x7f60c41f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c259c700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c40cc8d0 0x7f60c4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 -- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c40cc8d0 msgr2=0x7f60c4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c40cc8d0 0x7f60c4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 -- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60c415adc0 msgr2=0x7f60c41f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60c415adc0 0x7f60c41f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 -- 172.21.15.5:0/3031687105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8009550 con 0x7f60c415f7d0 2023-08-09T14:15:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c2d9d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00cc80 tx=0x7f60bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003c00 con 0x7f60c415f7d0 2023-08-09T14:15:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc003d60 con 0x7f60c415f7d0 2023-08-09T14:15:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c40c5920 con 0x7f60c415f7d0 2023-08-09T14:15:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00aaa0 con 0x7f60c415f7d0 2023-08-09T14:15:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.413+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c40c3d50 con 0x7f60c415f7d0 2023-08-09T14:15:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.414+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c40c38d0 con 0x7f60c415f7d0 2023-08-09T14:15:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.415+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60bc00ac00 con 0x7f60c415f7d0 2023-08-09T14:15:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.415+0000 7f60b2ffd700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 0x7f60a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.415+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f60bc088120 con 0x7f60c415f7d0 2023-08-09T14:15:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.415+0000 7f60c259c700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 0x7f60a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.416+0000 7f60c259c700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 0x7f60a406c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009c40 tx=0x7f60b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.420+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f60c40c38d0 con 0x7f60c415f7d0 2023-08-09T14:15:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:24.621+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60c40c4270 con 0x7f60c415f7d0 2023-08-09T14:15:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.337+0000 7f60b2ffd700 1 -- 172.21.15.5:0/3031687105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60c40c4270 con 0x7f60c415f7d0 2023-08-09T14:15:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.341+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 msgr2=0x7f60a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.341+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 0x7f60a406c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009c40 tx=0x7f60b8008030 comp rx=0 tx=0).stop 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.341+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 msgr2=0x7f60c40cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.341+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00cc80 tx=0x7f60bc00cf90 comp rx=0 tx=0).stop 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 shutdown_connections 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60a406a0e0 0x7f60a406c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c415f7d0 0x7f60c40cda00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60c40cc8d0 0x7f60c4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 --2- 172.21.15.5:0/3031687105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60c415adc0 0x7f60c41f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.342+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 >> 172.21.15.5:0/3031687105 conn(0x7f60c40b1a20 msgr2=0x7f60c40cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.343+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 shutdown_connections 2023-08-09T14:15:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.344+0000 7f60c896d700 1 -- 172.21.15.5:0/3031687105 wait complete. 2023-08-09T14:15:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-08-09T14:15:25.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T14:15:25.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.498+0000 7f93af958700 1 Processor -- start 2023-08-09T14:15:25.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.499+0000 7f93af958700 1 -- start start 2023-08-09T14:15:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93af958700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93af958700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93af958700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a806ab50 con 0x7f93a815d3a0 2023-08-09T14:15:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93af958700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80cd6c0 con 0x7f93a80cd1c0 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93af958700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80715a0 con 0x7f93a806a1c0 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93acef3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93ad6f4700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f93a815d3a0 0x7f93a80cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37204/0 (socket says 172.21.15.5:37204) 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60260/0 (socket says 172.21.15.5:60260) 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93ad6f4700 1 -- 172.21.15.5:0/12585021 learned_addr learned my addr 172.21.15.5:0/12585021 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93acef3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59488/0 (socket says 172.21.15.5:59488) 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f939ffff700 1 -- 172.21.15.5:0/12585021 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376852759 0 0) 0x7f9398001110 con 0x7f93a815d3a0 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f939ffff700 1 -- 172.21.15.5:0/12585021 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93940035b0 con 0x7f93a815d3a0 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 -- 172.21.15.5:0/12585021 >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 msgr2=0x7f93a80af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 --2- 172.21.15.5:0/12585021 >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 -- 172.21.15.5:0/12585021 >> v1:172.21.15.101:6789/0 conn(0x7f93a815d3a0 legacy=0x7f93a80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93adef5700 1 -- 172.21.15.5:0/12585021 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80712a0 con 0x7f93a806a1c0 2023-08-09T14:15:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.500+0000 7f93acef3700 1 --2- 172.21.15.5:0/12585021 >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93adef5700 1 --2- 172.21.15.5:0/12585021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009d90 tx=0x7f93a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3995f0d4605d61 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f939ffff700 1 -- 172.21.15.5:0/12585021 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000e070 con 0x7f93a806a1c0 2023-08-09T14:15:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f939ffff700 1 -- 172.21.15.5:0/12585021 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000bb20 con 0x7f93a806a1c0 2023-08-09T14:15:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f939ffff700 1 -- 172.21.15.5:0/12585021 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0012430 con 0x7f93a806a1c0 2023-08-09T14:15:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 -- 172.21.15.5:0/12585021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 msgr2=0x7f93a806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 --2- 172.21.15.5:0/12585021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009d90 tx=0x7f93a000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 -- 172.21.15.5:0/12585021 shutdown_connections 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 --2- 172.21.15.5:0/12585021 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a806a1c0 0x7f93a806a610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 --2- 172.21.15.5:0/12585021 >> v2:172.21.15.101:3300/0 conn(0x7f93a80cd1c0 0x7f93a80af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 -- 172.21.15.5:0/12585021 >> 172.21.15.5:0/12585021 conn(0x7f93a80b1970 msgr2=0x7f93a80b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 -- 172.21.15.5:0/12585021 shutdown_connections 2023-08-09T14:15:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.501+0000 7f93af958700 1 -- 172.21.15.5:0/12585021 wait complete. 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.503+0000 7f93af958700 1 Processor -- start 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.503+0000 7f93af958700 1 -- start start 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f93a806a1c0 0x7f93a815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a80cd1c0 0x7f93a80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8153d70 con 0x7f93a815d3a0 2023-08-09T14:15:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a81608d0 con 0x7f93a806a1c0 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93af958700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a81605f0 con 0x7f93a80cd1c0 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93adef5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93adef5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42452/0 (socket says 172.21.15.5:42452) 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93adef5700 1 -- 172.21.15.5:0/2982655110 learned_addr learned my addr 172.21.15.5:0/2982655110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93acef3700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a80cd1c0 0x7f93a80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.504+0000 7f93ad6f4700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f93a806a1c0 0x7f93a815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 -- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a80cd1c0 msgr2=0x7f93a80b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a80cd1c0 0x7f93a80b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 -- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f93a806a1c0 msgr2=0x7f93a815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f93a806a1c0 0x7f93a815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 -- 172.21.15.5:0/2982655110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40094a0 con 0x7f93a815d3a0 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93adef5700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93a0014040 tx=0x7f93a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00129f0 con 0x7f93a815d3a0 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0020070 con 0x7f93a815d3a0 2023-08-09T14:15:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0012db0 con 0x7f93a815d3a0 2023-08-09T14:15:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a0009a70 con 0x7f93a815d3a0 2023-08-09T14:15:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.505+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a80b2e40 con 0x7f93a815d3a0 2023-08-09T14:15:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.506+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8074600 con 0x7f93a815d3a0 2023-08-09T14:15:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.507+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93a0004040 con 0x7f93a815d3a0 2023-08-09T14:15:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.507+0000 7f939dffb700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 0x7f938c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.507+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f93a0022070 con 0x7f93a815d3a0 2023-08-09T14:15:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.507+0000 7f93ad6f4700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 0x7f938c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.508+0000 7f93ad6f4700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 0x7f938c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9398007fd0 tx=0x7f9398007c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.512+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f93a0055760 con 0x7f93a815d3a0 2023-08-09T14:15:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:25.711+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f93a815c850 con 0x7f93a815d3a0 2023-08-09T14:15:26.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.345+0000 7f939dffb700 1 -- 172.21.15.5:0/2982655110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f93a002c0d0 con 0x7f93a815d3a0 2023-08-09T14:15:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 msgr2=0x7f938c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 0x7f938c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9398007fd0 tx=0x7f9398007c40 comp rx=0 tx=0).stop 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 msgr2=0x7f93a815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93a0014040 tx=0x7f93a0004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 shutdown_connections 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f938c06a0e0 0x7f938c06c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93a815d3a0 0x7f93a815e490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f93a806a1c0 0x7f93a815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 --2- 172.21.15.5:0/2982655110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f93a80cd1c0 0x7f93a80b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.351+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 >> 172.21.15.5:0/2982655110 conn(0x7f93a80b1970 msgr2=0x7f93a80ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.353+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 shutdown_connections 2023-08-09T14:15:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.354+0000 7f93af958700 1 -- 172.21.15.5:0/2982655110 wait complete. 2023-08-09T14:15:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-08-09T14:15:26.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T14:15:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.509+0000 7f1e41740700 1 Processor -- start 2023-08-09T14:15:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.510+0000 7f1e41740700 1 -- start start 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e41740700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e41740700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f1e3c0d0130 0x7f1e3c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e41740700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0b40b0 con 0x7f1e3c160ac0 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e41740700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ce7a0 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e41740700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b48c0 con 0x7f1e3c0d0130 2023-08-09T14:15:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42456/0 (socket says 172.21.15.5:42456) 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e3c160ac0 0x7f1e3c0c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55876/0 (socket says 172.21.15.5:55876) 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 -- 172.21.15.5:0/205051235 learned_addr learned my addr 172.21.15.5:0/205051235 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3a7fc700 1 --2- 172.21.15.5:0/205051235 >> v2:172.21.15.101:3300/0 conn(0x7f1e3c0d0130 0x7f1e3c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 -- 172.21.15.5:0/205051235 >> v2:172.21.15.101:3300/0 conn(0x7f1e3c0d0130 msgr2=0x7f1e3c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 --2- 172.21.15.5:0/205051235 >> v2:172.21.15.101:3300/0 conn(0x7f1e3c0d0130 0x7f1e3c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 -- 172.21.15.5:0/205051235 >> v1:172.21.15.5:6789/0 conn(0x7f1e3c160ac0 legacy=0x7f1e3c0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 -- 172.21.15.5:0/205051235 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c160f50 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e39ffb700 1 -- 172.21.15.5:0/205051235 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202898130 0 0) 0x7f1e3c0b40b0 con 0x7f1e3c160ac0 2023-08-09T14:15:26.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.511+0000 7f1e3affd700 1 --2- 172.21.15.5:0/205051235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b91a0 tx=0x7f1e30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4a19e616aff612 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:26.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e39ffb700 1 -- 172.21.15.5:0/205051235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30011830 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e39ffb700 1 -- 172.21.15.5:0/205051235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30011990 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e39ffb700 1 -- 172.21.15.5:0/205051235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30011d20 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 -- 172.21.15.5:0/205051235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0cfd50 msgr2=0x7f1e3c0d3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 --2- 172.21.15.5:0/205051235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b91a0 tx=0x7f1e30009bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 -- 172.21.15.5:0/205051235 shutdown_connections 2023-08-09T14:15:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 --2- 172.21.15.5:0/205051235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0d3c10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 --2- 172.21.15.5:0/205051235 >> v2:172.21.15.101:3300/0 conn(0x7f1e3c0d0130 0x7f1e3c160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 -- 172.21.15.5:0/205051235 >> 172.21.15.5:0/205051235 conn(0x7f1e3c0d30f0 msgr2=0x7f1e3c0d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 -- 172.21.15.5:0/205051235 shutdown_connections 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.512+0000 7f1e41740700 1 -- 172.21.15.5:0/205051235 wait complete. 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.514+0000 7f1e41740700 1 Processor -- start 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.514+0000 7f1e41740700 1 -- start start 2023-08-09T14:15:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e3c160ac0 0x7f1e3c0b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b1470 con 0x7f1e3c0d0130 2023-08-09T14:15:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b2f40 con 0x7f1e3c0cfd50 2023-08-09T14:15:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e41740700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b3220 con 0x7f1e3c160ac0 2023-08-09T14:15:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42464/0 (socket says 172.21.15.5:42464) 2023-08-09T14:15:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 -- 172.21.15.5:0/1954618072 learned_addr learned my addr 172.21.15.5:0/1954618072 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3affd700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3b7fe700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e3c160ac0 0x7f1e3c0b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 -- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e3c160ac0 msgr2=0x7f1e3c0b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e3c160ac0 0x7f1e3c0b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 -- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e3c0cfd50 msgr2=0x7f1e3c0afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 -- 172.21.15.5:0/1954618072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30009550 con 0x7f1e3c0d0130 2023-08-09T14:15:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.515+0000 7f1e3a7fc700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e980 tx=0x7f1e2c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.516+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c009710 con 0x7f1e3c0d0130 2023-08-09T14:15:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.516+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00c850 con 0x7f1e3c0d0130 2023-08-09T14:15:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.516+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c0b3500 con 0x7f1e3c0d0130 2023-08-09T14:15:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.516+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00cbe0 con 0x7f1e3c0d0130 2023-08-09T14:15:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.516+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0b3ac0 con 0x7f1e3c0d0130 2023-08-09T14:15:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.517+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c074600 con 0x7f1e3c0d0130 2023-08-09T14:15:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.517+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e2c00cd40 con 0x7f1e3c0d0130 2023-08-09T14:15:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.517+0000 7f1e237fe700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 0x7f1e2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.518+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1e2c088600 con 0x7f1e3c0d0130 2023-08-09T14:15:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.518+0000 7f1e3affd700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 0x7f1e2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.518+0000 7f1e3affd700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 0x7f1e2806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000c00 tx=0x7f1e30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.522+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1e2c0578a0 con 0x7f1e3c0d0130 2023-08-09T14:15:26.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:26.770+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1e3c0c9460 con 0x7f1e3c0d0130 2023-08-09T14:15:27.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.346+0000 7f1e237fe700 1 -- 172.21.15.5:0/1954618072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1e2c057430 con 0x7f1e3c0d0130 2023-08-09T14:15:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 msgr2=0x7f1e2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 0x7f1e2806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000c00 tx=0x7f1e30008030 comp rx=0 tx=0).stop 2023-08-09T14:15:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 msgr2=0x7f1e3c0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e980 tx=0x7f1e2c00ed40 comp rx=0 tx=0).stop 2023-08-09T14:15:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 shutdown_connections 2023-08-09T14:15:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e2806a0e0 0x7f1e2806c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e3c160ac0 0x7f1e3c0b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e3c0cfd50 0x7f1e3c0afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 --2- 172.21.15.5:0/1954618072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3c0d0130 0x7f1e3c0b2860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.351+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 >> 172.21.15.5:0/1954618072 conn(0x7f1e3c0d30f0 msgr2=0x7f1e3c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:27.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.359+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 shutdown_connections 2023-08-09T14:15:27.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.359+0000 7f1e41740700 1 -- 172.21.15.5:0/1954618072 wait complete. 2023-08-09T14:15:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 3 and data pool 4 2023-08-09T14:15:27.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.511+0000 7f21b0840700 1 Processor -- start 2023-08-09T14:15:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.511+0000 7f21b0840700 1 -- start start 2023-08-09T14:15:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f21ac15b1e0 0x7f21ac0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ac0b2f90 0x7f21ac0ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0b3420 con 0x7f21ac0b2f90 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0cd880 con 0x7f21ac15b1e0 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21b0840700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0d1e50 con 0x7f21ac0cb590 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21aad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ac0b2f90 0x7f21ac0ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21aad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ac0b2f90 0x7f21ac0ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42474/0 (socket says 172.21.15.5:42474) 2023-08-09T14:15:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21aad9d700 1 -- 172.21.15.5:0/1738311064 learned_addr learned my addr 172.21.15.5:0/1738311064 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21aa59c700 1 --2- 172.21.15.5:0/1738311064 >> v2:172.21.15.101:3300/0 conn(0x7f21ac15b1e0 0x7f21ac0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.512+0000 7f21a9d9b700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 -- 172.21.15.5:0/1738311064 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 msgr2=0x7f21ac0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 -- 172.21.15.5:0/1738311064 >> v2:172.21.15.101:3300/0 conn(0x7f21ac15b1e0 msgr2=0x7f21ac0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 --2- 172.21.15.5:0/1738311064 >> v2:172.21.15.101:3300/0 conn(0x7f21ac15b1e0 0x7f21ac0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 -- 172.21.15.5:0/1738311064 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0cd5c0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21aad9d700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0ceb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21ac06d960 tx=0x7f21a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b3a60fa1eb4522 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21a959a700 1 -- 172.21.15.5:0/1738311064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400e070 con 0x7f21ac0b2f90 2023-08-09T14:15:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21a959a700 1 -- 172.21.15.5:0/1738311064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400b910 con 0x7f21ac0b2f90 2023-08-09T14:15:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21a959a700 1 -- 172.21.15.5:0/1738311064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400bcc0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.513+0000 7f21b0840700 1 -- 172.21.15.5:0/1738311064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 msgr2=0x7f21ac0ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0ceb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21ac06d960 tx=0x7f21a400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 -- 172.21.15.5:0/1738311064 shutdown_connections 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 --2- 172.21.15.5:0/1738311064 >> v2:172.21.15.101:3300/0 conn(0x7f21ac15b1e0 0x7f21ac0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0ceb10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 --2- 172.21.15.5:0/1738311064 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 -- 172.21.15.5:0/1738311064 >> 172.21.15.5:0/1738311064 conn(0x7f21ac0d0fd0 msgr2=0x7f21ac0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 -- 172.21.15.5:0/1738311064 shutdown_connections 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.514+0000 7f21b0840700 1 -- 172.21.15.5:0/1738311064 wait complete. 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.515+0000 7f21b0840700 1 Processor -- start 2023-08-09T14:15:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.515+0000 7f21b0840700 1 -- start start 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac1f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 0x7f21ac06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0c7810 con 0x7f21ac0b2f90 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1f35d0 con 0x7f21ac15b1e0 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21b0840700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0c4f70 con 0x7f21ac0cb590 2023-08-09T14:15:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42476/0 (socket says 172.21.15.5:42476) 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 -- 172.21.15.5:0/643544521 learned_addr learned my addr 172.21.15.5:0/643544521 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aad9d700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 0x7f21ac06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21a9d9b700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac1f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 -- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 msgr2=0x7f21ac1f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac1f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 -- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 msgr2=0x7f21ac06b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 0x7f21ac06b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 -- 172.21.15.5:0/643544521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009b30 con 0x7f21ac0b2f90 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aad9d700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 0x7f21ac06b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21a9d9b700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac1f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.516+0000 7f21aa59c700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9b0 tx=0x7f219c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c009710 con 0x7f21ac0b2f90 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00c850 con 0x7f21ac0b2f90 2023-08-09T14:15:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac15c610 con 0x7f21ac0b2f90 2023-08-09T14:15:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00cbc0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac15cbd0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.517+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac15d220 con 0x7f21ac0b2f90 2023-08-09T14:15:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.518+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f219c00cd20 con 0x7f21ac0b2f90 2023-08-09T14:15:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.518+0000 7f219affd700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 0x7f218c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.518+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f219c0886e0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.519+0000 7f21a9d9b700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 0x7f218c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.519+0000 7f21a9d9b700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 0x7f218c06c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0b64e0 tx=0x7f21a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.523+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f219c057860 con 0x7f21ac0b2f90 2023-08-09T14:15:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.734+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21ac074600 con 0x7f21ac0b2f90 2023-08-09T14:15:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.735+0000 7f219affd700 1 -- 172.21.15.5:0/643544521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7f219c0573f0 con 0x7f21ac0b2f90 2023-08-09T14:15:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:27.738 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:26.771996+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 msgr2=0x7f218c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 0x7f218c06c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0b64e0 tx=0x7f21a0008040 comp rx=0 tx=0).stop 2023-08-09T14:15:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 msgr2=0x7f21ac0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9b0 tx=0x7f219c00ed70 comp rx=0 tx=0).stop 2023-08-09T14:15:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 shutdown_connections 2023-08-09T14:15:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f218c06a0e0 0x7f218c06c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f21ac15b1e0 0x7f21ac06b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac0b2f90 0x7f21ac0b00d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 --2- 172.21.15.5:0/643544521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f21ac0cb590 0x7f21ac1f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 >> 172.21.15.5:0/643544521 conn(0x7f21ac0d0fd0 msgr2=0x7f21ac15a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 shutdown_connections 2023-08-09T14:15:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.737+0000 7f21b0840700 1 -- 172.21.15.5:0/643544521 wait complete. 2023-08-09T14:15:27.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:27.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.875+0000 7f6f4e744700 1 Processor -- start 2023-08-09T14:15:27.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.875+0000 7f6f4e744700 1 -- start start 2023-08-09T14:15:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.876+0000 7f6f4e744700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 0x7f6f480cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.876+0000 7f6f4e744700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f4806a640 0x7f6f4806d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.876+0000 7f6f4e744700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4806e850 con 0x7f6f4806a1c0 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.876+0000 7f6f4e744700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4806aad0 con 0x7f6f4806a640 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.876+0000 7f6f4e744700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480cf7b0 con 0x7f6f4815d400 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f4806a640 0x7f6f4806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f47fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 0x7f6f480cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f477fe700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f6f4806a1c0 0x7f6f4806cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37248/0 (socket says 172.21.15.5:37248) 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f4806a640 0x7f6f4806d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59532/0 (socket says 172.21.15.5:59532) 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f477fe700 1 -- 172.21.15.5:0/2552076487 learned_addr learned my addr 172.21.15.5:0/2552076487 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f46ffd700 1 -- 172.21.15.5:0/2552076487 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955995645 0 0) 0x7f6f4806e850 con 0x7f6f4806a1c0 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 -- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 msgr2=0x7f6f480cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:27.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 0x7f6f480cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 -- 172.21.15.5:0/2552076487 >> v1:172.21.15.101:6789/0 conn(0x7f6f4806a1c0 legacy=0x7f6f4806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 -- 172.21.15.5:0/2552076487 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480cfa90 con 0x7f6f4806a640 2023-08-09T14:15:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f47fff700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 0x7f6f480cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f4cce1700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4806a640 0x7f6f4806d460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009dc0 tx=0x7f6f4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a8b2ea4e53c62e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f46ffd700 1 -- 172.21.15.5:0/2552076487 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000e070 con 0x7f6f4806a640 2023-08-09T14:15:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f46ffd700 1 -- 172.21.15.5:0/2552076487 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4000bae0 con 0x7f6f4806a640 2023-08-09T14:15:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.877+0000 7f6f46ffd700 1 -- 172.21.15.5:0/2552076487 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000be90 con 0x7f6f4806a640 2023-08-09T14:15:27.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 -- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4806a640 msgr2=0x7f6f4806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4806a640 0x7f6f4806d460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009dc0 tx=0x7f6f4000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 -- 172.21.15.5:0/2552076487 shutdown_connections 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4806a640 0x7f6f4806d460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 --2- 172.21.15.5:0/2552076487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4815d400 0x7f6f480cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 -- 172.21.15.5:0/2552076487 >> 172.21.15.5:0/2552076487 conn(0x7f6f480b1900 msgr2=0x7f6f480b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 -- 172.21.15.5:0/2552076487 shutdown_connections 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.878+0000 7f6f4e744700 1 -- 172.21.15.5:0/2552076487 wait complete. 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.879+0000 7f6f4e744700 1 Processor -- start 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.879+0000 7f6f4e744700 1 -- start start 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 0x7f6f481608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4815d400 0x7f6f4814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481588a0 con 0x7f6f4806a640 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48160e30 con 0x7f6f4815d400 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4e744700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48158b10 con 0x7f6f4806a1c0 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42494/0 (socket says 172.21.15.5:42494) 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 -- 172.21.15.5:0/1184587797 learned_addr learned my addr 172.21.15.5:0/1184587797 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f4cce1700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4815d400 0x7f6f4814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f47fff700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 0x7f6f481608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 -- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 msgr2=0x7f6f481608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 0x7f6f481608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 -- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4815d400 msgr2=0x7f6f4814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4815d400 0x7f6f4814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f477fe700 1 -- 172.21.15.5:0/1184587797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380094a0 con 0x7f6f4806a640 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.880+0000 7f6f47fff700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 0x7f6f481608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f477fe700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000c550 tx=0x7f6f3000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30004c80 con 0x7f6f4806a640 2023-08-09T14:15:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30004e00 con 0x7f6f4806a640 2023-08-09T14:15:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f40009a70 con 0x7f6f4806a640 2023-08-09T14:15:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30007310 con 0x7f6f4806a640 2023-08-09T14:15:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.881+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f481590d0 con 0x7f6f4806a640 2023-08-09T14:15:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.882+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f481592c0 con 0x7f6f4806a640 2023-08-09T14:15:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.882+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f30007470 con 0x7f6f4806a640 2023-08-09T14:15:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.883+0000 7f6f44ff9700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 0x7f6f2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.883+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f30088210 con 0x7f6f4806a640 2023-08-09T14:15:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.883+0000 7f6f47fff700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 0x7f6f2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.883+0000 7f6f47fff700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 0x7f6f2806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009dc0 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:27.887+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f30053900 con 0x7f6f4806a640 2023-08-09T14:15:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.086+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f48074600 con 0x7f6f4806a640 2023-08-09T14:15:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.087+0000 7f6f44ff9700 1 -- 172.21.15.5:0/1184587797 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7f6f30056f20 con 0x7f6f4806a640 2023-08-09T14:15:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:28.090 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:26.771996+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 msgr2=0x7f6f2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 0x7f6f2806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009dc0 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 msgr2=0x7f6f4814ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000c550 tx=0x7f6f3000c860 comp rx=0 tx=0).stop 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 shutdown_connections 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f2806a0e0 0x7f6f2806c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4815d400 0x7f6f4814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4806a1c0 0x7f6f481608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 --2- 172.21.15.5:0/1184587797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4806a640 0x7f6f4814ecf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 >> 172.21.15.5:0/1184587797 conn(0x7f6f480b1900 msgr2=0x7f6f480acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 shutdown_connections 2023-08-09T14:15:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.089+0000 7f6f4e744700 1 -- 172.21.15.5:0/1184587797 wait complete. 2023-08-09T14:15:28.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T14:15:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.229+0000 7fdbc521c700 1 Processor -- start 2023-08-09T14:15:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbc521c700 1 -- start start 2023-08-09T14:15:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbc521c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbc00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbc521c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc00cb2d0 con 0x7fdbc00ce410 2023-08-09T14:15:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbc521c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc00cb5b0 con 0x7fdbc00b2c70 2023-08-09T14:15:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbc521c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00cb890 con 0x7fdbc0159e90 2023-08-09T14:15:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbbf59e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbc00ce410 0x7fdbc00cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55916/0 (socket says 172.21.15.5:55916) 2023-08-09T14:15:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.230+0000 7fdbbf59e700 1 -- 172.21.15.5:0/3700457009 learned_addr learned my addr 172.21.15.5:0/3700457009 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbc00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880187065 0 0) 0x7fdbc00cb2d0 con 0x7fdbc00ce410 2023-08-09T14:15:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbac0035b0 con 0x7fdbc00ce410 2023-08-09T14:15:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600846352 0 0) 0x7fdbc00cb5b0 con 0x7fdbc00b2c70 2023-08-09T14:15:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc00cb2d0 con 0x7fdbc00b2c70 2023-08-09T14:15:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481981140 0 0) 0x7fdbac0035b0 con 0x7fdbc00ce410 2023-08-09T14:15:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 msgr2=0x7fdbc00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbc00cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 >> v1:172.21.15.101:6789/0 conn(0x7fdbc00b2c70 legacy=0x7fdbc006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00cbb70 con 0x7fdbc00ce410 2023-08-09T14:15:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fdbb80019f0 con 0x7fdbc00ce410 2023-08-09T14:15:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 >> v1:172.21.15.5:6789/0 conn(0x7fdbc00ce410 legacy=0x7fdbc00cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac003bc0 0x7fdbac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbac004d90 0x7fdbac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00cb890 con 0x7fdbac003bc0 2023-08-09T14:15:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac00bac0 con 0x7fdbac004d90 2023-08-09T14:15:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac00bc80 con 0x7fdbc0159e90 2023-08-09T14:15:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac003bc0 0x7fdbac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbf59e700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbac004d90 0x7fdbac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.231+0000 7fdbbe59c700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 -- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 msgr2=0x7fdbac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbc0159e90 0x7fdbac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 -- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbac004d90 msgr2=0x7fdbac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbac004d90 0x7fdbac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 -- 172.21.15.5:0/3700457009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0035b0 con 0x7fdbac003bc0 2023-08-09T14:15:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbf59e700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbac004d90 0x7fdbac005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac003bc0 0x7fdbac003fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009b60 tx=0x7fdbac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b401d692f96e132 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000e6c0 con 0x7fdbac003bc0 2023-08-09T14:15:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000e820 con 0x7fdbac003bc0 2023-08-09T14:15:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbdd9b700 1 -- 172.21.15.5:0/3700457009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000eb90 con 0x7fdbac003bc0 2023-08-09T14:15:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 -- 172.21.15.5:0/3700457009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac003bc0 msgr2=0x7fdbac003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 --2- 172.21.15.5:0/3700457009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac003bc0 0x7fdbac003fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009b60 tx=0x7fdbac005880 comp rx=0 tx=0).stop 2023-08-09T14:15:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbbf59e700 1 -- 172.21.15.5:0/3700457009 reap_dead start 2023-08-09T14:15:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 -- 172.21.15.5:0/3700457009 shutdown_connections 2023-08-09T14:15:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 -- 172.21.15.5:0/3700457009 >> 172.21.15.5:0/3700457009 conn(0x7fdbc00b1970 msgr2=0x7fdbc00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 -- 172.21.15.5:0/3700457009 shutdown_connections 2023-08-09T14:15:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.232+0000 7fdbc521c700 1 -- 172.21.15.5:0/3700457009 wait complete. 2023-08-09T14:15:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.234+0000 7fdbc521c700 1 Processor -- start 2023-08-09T14:15:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.234+0000 7fdbc521c700 1 -- start start 2023-08-09T14:15:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 0x7fdbc0151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbc01f2320 0x7fdbc0157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01f1660 con 0x7fdbc0157780 2023-08-09T14:15:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0157fa0 con 0x7fdbc01f2320 2023-08-09T14:15:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01f1e90 con 0x7fdbac003bc0 2023-08-09T14:15:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42512/0 (socket says 172.21.15.5:42512) 2023-08-09T14:15:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 -- 172.21.15.5:0/2764880925 learned_addr learned my addr 172.21.15.5:0/2764880925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbe59c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbc01f2320 0x7fdbc0157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 0x7fdbc0151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 -- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 msgr2=0x7fdbc0151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 0x7fdbc0151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 -- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbc01f2320 msgr2=0x7fdbc0157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbc01f2320 0x7fdbc0157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 -- 172.21.15.5:0/2764880925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0157cc0 con 0x7fdbc0157780 2023-08-09T14:15:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 0x7fdbc0151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbbf59e700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001330 tx=0x7fdbb80073e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8012650 con 0x7fdbc0157780 2023-08-09T14:15:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb80127f0 con 0x7fdbc0157780 2023-08-09T14:15:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc01f1840 con 0x7fdbc0157780 2023-08-09T14:15:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8012ba0 con 0x7fdbc0157780 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.235+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc0154c00 con 0x7fdbc0157780 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.236+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc01f2020 con 0x7fdbc0157780 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.237+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdbb8012d00 con 0x7fdbc0157780 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.237+0000 7fdbb77fe700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 0x7fdba006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.237+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbb808b5d0 con 0x7fdbc0157780 2023-08-09T14:15:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.238+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 0x7fdba006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.238+0000 7fdbbed9d700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 0x7fdba006c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.242+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdbb8056cc0 con 0x7fdbc0157780 2023-08-09T14:15:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:28.489+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdbc0074600 con 0x7fdbc0157780 2023-08-09T14:15:29.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.369+0000 7fdbb77fe700 1 -- 172.21.15.5:0/2764880925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdbb805a2e0 con 0x7fdbc0157780 2023-08-09T14:15:29.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.371+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 msgr2=0x7fdba006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.371+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 0x7fdba006c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0008030 comp rx=0 tx=0).stop 2023-08-09T14:15:29.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 msgr2=0x7fdbc00c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001330 tx=0x7fdbb80073e0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 shutdown_connections 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdba006a0e0 0x7fdba006c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc0157780 0x7fdbc00c8e80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdbac003bc0 0x7fdbc0151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 --2- 172.21.15.5:0/2764880925 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdbc01f2320 0x7fdbc0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 >> 172.21.15.5:0/2764880925 conn(0x7fdbc00b1970 msgr2=0x7fdbc00cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:29.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 shutdown_connections 2023-08-09T14:15:29.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.372+0000 7fdbc521c700 1 -- 172.21.15.5:0/2764880925 wait complete. 2023-08-09T14:15:29.389 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T14:15:29.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T14:15:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.522+0000 7f8c8be20700 1 Processor -- start 2023-08-09T14:15:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.522+0000 7f8c8be20700 1 -- start start 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8be20700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 0x7f8c840af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8be20700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c8406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8be20700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8406ab50 con 0x7f8c8415d3a0 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8be20700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840cd6c0 con 0x7f8c840cd1c0 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8be20700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840715a0 con 0x7f8c8406a1c0 2023-08-09T14:15:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c89bbc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c8415d3a0 0x7f8c840cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55932/0 (socket says 172.21.15.5:55932) 2023-08-09T14:15:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c89bbc700 1 -- 172.21.15.5:0/3903249880 learned_addr learned my addr 172.21.15.5:0/3903249880 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c893bb700 1 --2- 172.21.15.5:0/3903249880 >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 0x7f8c840af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/3903249880 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c8406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c88bba700 1 -- 172.21.15.5:0/3903249880 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808609396 0 0) 0x7f8c80001110 con 0x7f8c8415d3a0 2023-08-09T14:15:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c88bba700 1 -- 172.21.15.5:0/3903249880 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c700035b0 con 0x7f8c8415d3a0 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/3903249880 >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 msgr2=0x7f8c840af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/3903249880 >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 0x7f8c840af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/3903249880 >> v1:172.21.15.5:6789/0 conn(0x7f8c8415d3a0 legacy=0x7f8c840cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/3903249880 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840712a0 con 0x7f8c8406a1c0 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.523+0000 7f8c893bb700 1 --2- 172.21.15.5:0/3903249880 >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 0x7f8c840af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/3903249880 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c8406a610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009d90 tx=0x7f8c7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d19cdd4fdfcd5c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c88bba700 1 -- 172.21.15.5:0/3903249880 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00e070 con 0x7f8c8406a1c0 2023-08-09T14:15:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c88bba700 1 -- 172.21.15.5:0/3903249880 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00bb20 con 0x7f8c8406a1c0 2023-08-09T14:15:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c88bba700 1 -- 172.21.15.5:0/3903249880 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c012430 con 0x7f8c8406a1c0 2023-08-09T14:15:29.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 -- 172.21.15.5:0/3903249880 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 msgr2=0x7f8c8406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 --2- 172.21.15.5:0/3903249880 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c8406a610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009d90 tx=0x7f8c7c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:29.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 -- 172.21.15.5:0/3903249880 shutdown_connections 2023-08-09T14:15:29.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 --2- 172.21.15.5:0/3903249880 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c8406a610 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 --2- 172.21.15.5:0/3903249880 >> v2:172.21.15.101:3300/0 conn(0x7f8c840cd1c0 0x7f8c840af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 -- 172.21.15.5:0/3903249880 >> 172.21.15.5:0/3903249880 conn(0x7f8c840b1970 msgr2=0x7f8c840b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 -- 172.21.15.5:0/3903249880 shutdown_connections 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.524+0000 7f8c8be20700 1 -- 172.21.15.5:0/3903249880 wait complete. 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.525+0000 7f8c8be20700 1 Processor -- start 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 -- start start 2023-08-09T14:15:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c841f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8c840cd1c0 0x7f8c841f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c841f6eb0 con 0x7f8c8415d3a0 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b4990 con 0x7f8c840cd1c0 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8be20700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c841f3920 con 0x7f8c8406a1c0 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8a3bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8a3bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42526/0 (socket says 172.21.15.5:42526) 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/4071387465 learned_addr learned my addr 172.21.15.5:0/4071387465 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.526+0000 7f8c89bbc700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c841f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c893bb700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8c840cd1c0 0x7f8c841f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 msgr2=0x7f8c841f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c841f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8c840cd1c0 msgr2=0x7f8c841f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8c840cd1c0 0x7f8c841f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 -- 172.21.15.5:0/4071387465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740094a0 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8a3bd700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c014040 tx=0x7f8c7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0129f0 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c020070 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c012db0 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c009a70 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.527+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c841f3360 con 0x7f8c8415d3a0 2023-08-09T14:15:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.528+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c840b4b90 con 0x7f8c8415d3a0 2023-08-09T14:15:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.528+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c7c004040 con 0x7f8c8415d3a0 2023-08-09T14:15:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.529+0000 7f8c7a7fc700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 0x7f8c6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.529+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c7c022070 con 0x7f8c8415d3a0 2023-08-09T14:15:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.529+0000 7f8c89bbc700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 0x7f8c6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.529+0000 7f8c89bbc700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 0x7f8c6806c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c80001270 tx=0x7f8c80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.533+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8c840b4b90 con 0x7f8c8415d3a0 2023-08-09T14:15:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:29.780+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8c840b4b50 con 0x7f8c8415d3a0 2023-08-09T14:15:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.377+0000 7f8c7a7fc700 1 -- 172.21.15.5:0/4071387465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c7c055960 con 0x7f8c8415d3a0 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 msgr2=0x7f8c6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 0x7f8c6806c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c80001270 tx=0x7f8c80009040 comp rx=0 tx=0).stop 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 msgr2=0x7f8c8415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c014040 tx=0x7f8c7c004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 shutdown_connections 2023-08-09T14:15:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8c6806a0e0 0x7f8c6806c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c8415d3a0 0x7f8c8415afa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8c8406a1c0 0x7f8c841f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 --2- 172.21.15.5:0/4071387465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8c840cd1c0 0x7f8c841f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 >> 172.21.15.5:0/4071387465 conn(0x7f8c840b1970 msgr2=0x7f8c8415c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 shutdown_connections 2023-08-09T14:15:30.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.380+0000 7f8c8be20700 1 -- 172.21.15.5:0/4071387465 wait complete. 2023-08-09T14:15:30.397 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T14:15:30.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:15:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.527+0000 7ff984b0e700 1 Processor -- start 2023-08-09T14:15:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.527+0000 7ff984b0e700 1 -- start start 2023-08-09T14:15:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff984b0e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7ff98015d400 0x7ff9800cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff984b0e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff98006d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff984b0e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98006e850 con 0x7ff98006a1c0 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff984b0e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98006aad0 con 0x7ff98015d400 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff984b0e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800cf7b0 con 0x7ff98006a640 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff97dd9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff98006a1c0 0x7ff98006cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55946/0 (socket says 172.21.15.5:55946) 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff97dd9b700 1 -- 172.21.15.5:0/479203515 learned_addr learned my addr 172.21.15.5:0/479203515 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff97e59c700 1 --2- 172.21.15.5:0/479203515 >> v2:172.21.15.101:3300/0 conn(0x7ff98015d400 0x7ff9800cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.528+0000 7ff97ed9d700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff98006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97d59a700 1 -- 172.21.15.5:0/479203515 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294845201 0 0) 0x7ff98006e850 con 0x7ff98006a1c0 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97d59a700 1 -- 172.21.15.5:0/479203515 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680035b0 con 0x7ff98006a1c0 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97e59c700 1 -- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 msgr2=0x7ff98006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97e59c700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff98006d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97e59c700 1 -- 172.21.15.5:0/479203515 >> v1:172.21.15.5:6789/0 conn(0x7ff98006a1c0 legacy=0x7ff98006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97e59c700 1 -- 172.21.15.5:0/479203515 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800cfa90 con 0x7ff98015d400 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97ed9d700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff98006d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97e59c700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cd940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff970009840 tx=0x7ff970009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63881e8cecfc6873 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97d59a700 1 -- 172.21.15.5:0/479203515 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970011830 con 0x7ff98015d400 2023-08-09T14:15:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97d59a700 1 -- 172.21.15.5:0/479203515 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970011990 con 0x7ff98015d400 2023-08-09T14:15:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.529+0000 7ff97d59a700 1 -- 172.21.15.5:0/479203515 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970011d20 con 0x7ff98015d400 2023-08-09T14:15:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 -- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 msgr2=0x7ff9800cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cd940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff970009840 tx=0x7ff970009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 -- 172.21.15.5:0/479203515 shutdown_connections 2023-08-09T14:15:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff98006d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 --2- 172.21.15.5:0/479203515 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cd940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 -- 172.21.15.5:0/479203515 >> 172.21.15.5:0/479203515 conn(0x7ff9800b1900 msgr2=0x7ff9800b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 -- 172.21.15.5:0/479203515 shutdown_connections 2023-08-09T14:15:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.530+0000 7ff984b0e700 1 -- 172.21.15.5:0/479203515 wait complete. 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.531+0000 7ff984b0e700 1 Processor -- start 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.531+0000 7ff984b0e700 1 -- start start 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff9800c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980159900 con 0x7ff98006a1c0 2023-08-09T14:15:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9801f3c70 con 0x7ff98015d400 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff984b0e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff980158a50 con 0x7ff98006a640 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42536/0 (socket says 172.21.15.5:42536) 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 -- 172.21.15.5:0/3849394977 learned_addr learned my addr 172.21.15.5:0/3849394977 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97dd9b700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff9800c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97ed9d700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 -- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 msgr2=0x7ff9800c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff9800c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 -- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 msgr2=0x7ff9800cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.532+0000 7ff97e59c700 1 -- 172.21.15.5:0/3849394977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff978009a70 con 0x7ff98006a1c0 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff97e59c700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff970000c00 tx=0x7ff970004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970004550 con 0x7ff98006a1c0 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97001f070 con 0x7ff98006a1c0 2023-08-09T14:15:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700094a0 con 0x7ff98006a1c0 2023-08-09T14:15:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700038e0 con 0x7ff98006a1c0 2023-08-09T14:15:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.533+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff980158fd0 con 0x7ff98006a1c0 2023-08-09T14:15:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.534+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980074600 con 0x7ff98006a1c0 2023-08-09T14:15:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.534+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff970003a40 con 0x7ff98006a1c0 2023-08-09T14:15:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.534+0000 7ff96effd700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.535+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff970021070 con 0x7ff98006a1c0 2023-08-09T14:15:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.535+0000 7ff97dd9b700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.535+0000 7ff97dd9b700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 0x7ff96006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff98015a1c0 tx=0x7ff974007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.539+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff9700553e0 con 0x7ff98006a1c0 2023-08-09T14:15:30.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.783+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff980071530 con 0x7ff98006a1c0 2023-08-09T14:15:30.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.784+0000 7ff96effd700 1 -- 172.21.15.5:0/3849394977 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7ff970015020 con 0x7ff98006a1c0 2023-08-09T14:15:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:30.787 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:15:30.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 msgr2=0x7ff96006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 0x7ff96006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff98015a1c0 tx=0x7ff974007dc0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 msgr2=0x7ff9801f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff970000c00 tx=0x7ff970004750 comp rx=0 tx=0).stop 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 shutdown_connections 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff98015d400 0x7ff9800cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98006a1c0 0x7ff9801f3730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 --2- 172.21.15.5:0/3849394977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff98006a640 0x7ff9800c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 >> 172.21.15.5:0/3849394977 conn(0x7ff9800b1900 msgr2=0x7ff9800cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:30.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 shutdown_connections 2023-08-09T14:15:30.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.786+0000 7ff984b0e700 1 -- 172.21.15.5:0/3849394977 wait complete. 2023-08-09T14:15:30.790 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:15:30.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.923+0000 7f167416f700 1 Processor -- start 2023-08-09T14:15:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.923+0000 7f167416f700 1 -- start start 2023-08-09T14:15:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167416f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f166c154600 0x7f166c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167416f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f166c0ce410 0x7f166c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167416f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0cee00 con 0x7f166c15b360 2023-08-09T14:15:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167416f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c15eb20 con 0x7f166c154600 2023-08-09T14:15:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167416f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c15e2d0 con 0x7f166c0ce410 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f166c154600 0x7f166c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f166c154600 0x7f166c15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42544/0 (socket says 172.21.15.5:42544) 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167170a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f166c15b360 0x7f166c15dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55960/0 (socket says 172.21.15.5:55960) 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 -- 172.21.15.5:0/1832228146 learned_addr learned my addr 172.21.15.5:0/1832228146 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f167270c700 1 --2- 172.21.15.5:0/1832228146 >> v2:172.21.15.101:3300/0 conn(0x7f166c0ce410 0x7f166c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 -- 172.21.15.5:0/1832228146 >> v2:172.21.15.101:3300/0 conn(0x7f166c0ce410 msgr2=0x7f166c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 --2- 172.21.15.5:0/1832228146 >> v2:172.21.15.101:3300/0 conn(0x7f166c0ce410 0x7f166c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 -- 172.21.15.5:0/1832228146 >> v1:172.21.15.5:6789/0 conn(0x7f166c15b360 legacy=0x7f166c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.924+0000 7f1671f0b700 1 -- 172.21.15.5:0/1832228146 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c06d4f0 con 0x7f166c154600 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f1671f0b700 1 --2- 172.21.15.5:0/1832228146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c15b790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ca810 tx=0x7f165c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf2a4282827b0bf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f1670f09700 1 -- 172.21.15.5:0/1832228146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00dd30 con 0x7f166c154600 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f1670f09700 1 -- 172.21.15.5:0/1832228146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00de90 con 0x7f166c154600 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f1670f09700 1 -- 172.21.15.5:0/1832228146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c010690 con 0x7f166c154600 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 -- 172.21.15.5:0/1832228146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 msgr2=0x7f166c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 --2- 172.21.15.5:0/1832228146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c15b790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ca810 tx=0x7f165c00be70 comp rx=0 tx=0).stop 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 -- 172.21.15.5:0/1832228146 shutdown_connections 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 --2- 172.21.15.5:0/1832228146 >> v2:172.21.15.101:3300/0 conn(0x7f166c0ce410 0x7f166c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 --2- 172.21.15.5:0/1832228146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c15b790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 -- 172.21.15.5:0/1832228146 >> 172.21.15.5:0/1832228146 conn(0x7f166c0b1900 msgr2=0x7f166c0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 -- 172.21.15.5:0/1832228146 shutdown_connections 2023-08-09T14:15:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.925+0000 7f167416f700 1 -- 172.21.15.5:0/1832228146 wait complete. 2023-08-09T14:15:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 Processor -- start 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 -- start start 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 0x7f166c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f166c15b360 0x7f166c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0b4000 con 0x7f166c154600 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0b4250 con 0x7f166c15b360 2023-08-09T14:15:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167416f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0b4530 con 0x7f166c0ce410 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167170a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167170a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42550/0 (socket says 172.21.15.5:42550) 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.927+0000 7f167170a700 1 -- 172.21.15.5:0/652622709 learned_addr learned my addr 172.21.15.5:0/652622709 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167270c700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f166c15b360 0x7f166c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f1671f0b700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 0x7f166c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 -- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 msgr2=0x7f166c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 0x7f166c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 -- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f166c15b360 msgr2=0x7f166c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f166c15b360 0x7f166c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 -- 172.21.15.5:0/652622709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c00b7f0 con 0x7f166c154600 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f1671f0b700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 0x7f166c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167170a700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f166800c4d0 tx=0x7f166800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005cb0 con 0x7f166c154600 2023-08-09T14:15:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668005e10 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c0b4810 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680072d0 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.928+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c0b4dd0 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.929+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c074600 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.929+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1668007430 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.930+0000 7f16627fc700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 0x7f165006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.930+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1668087690 con 0x7f166c154600 2023-08-09T14:15:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.930+0000 7f1671f0b700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 0x7f165006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.931+0000 7f1671f0b700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 0x7f165006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f165c00beb0 tx=0x7f165c012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:30.934+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1668052e30 con 0x7f166c154600 2023-08-09T14:15:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.134+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f166c0cee00 con 0x7f166c154600 2023-08-09T14:15:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.135+0000 7f16627fc700 1 -- 172.21.15.5:0/652622709 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f166c0cee00 con 0x7f166c154600 2023-08-09T14:15:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:31.138 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.137+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 msgr2=0x7f165006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.137+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 0x7f165006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f165c00beb0 tx=0x7f165c012000 comp rx=0 tx=0).stop 2023-08-09T14:15:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 msgr2=0x7f166c0c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f166800c4d0 tx=0x7f166800c890 comp rx=0 tx=0).stop 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 shutdown_connections 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f165006a0e0 0x7f165006c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f166c15b360 0x7f166c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f166c0ce410 0x7f166c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 --2- 172.21.15.5:0/652622709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166c154600 0x7f166c0c5940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 >> 172.21.15.5:0/652622709 conn(0x7f166c0b1900 msgr2=0x7f166c15d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 shutdown_connections 2023-08-09T14:15:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.138+0000 7f167416f700 1 -- 172.21.15.5:0/652622709 wait complete. 2023-08-09T14:15:31.152 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T14:15:31.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:15:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.275+0000 7f954c123700 1 Processor -- start 2023-08-09T14:15:31.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.275+0000 7f954c123700 1 -- start start 2023-08-09T14:15:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954c123700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f954406a1c0 0x7f954406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954c123700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95440cc780 0x7f95440ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954c123700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95440ce050 con 0x7f954415d400 2023-08-09T14:15:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954c123700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954406ab80 con 0x7f95440cc780 2023-08-09T14:15:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954c123700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954406e850 con 0x7f954406a1c0 2023-08-09T14:15:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95440cc780 0x7f95440ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95440cc780 0x7f95440ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42560/0 (socket says 172.21.15.5:42560) 2023-08-09T14:15:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 -- 172.21.15.5:0/1324140650 learned_addr learned my addr 172.21.15.5:0/1324140650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f95496be700 1 --2- 172.21.15.5:0/1324140650 >> v2:172.21.15.101:3300/0 conn(0x7f954406a1c0 0x7f954406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 -- 172.21.15.5:0/1324140650 >> v2:172.21.15.101:3300/0 conn(0x7f954406a1c0 msgr2=0x7f954406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 --2- 172.21.15.5:0/1324140650 >> v2:172.21.15.101:3300/0 conn(0x7f954406a1c0 0x7f954406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 -- 172.21.15.5:0/1324140650 >> v1:172.21.15.101:6789/0 conn(0x7f954415d400 legacy=0x7f95440cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.276+0000 7f954a6c0700 1 -- 172.21.15.5:0/1324140650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440cf7b0 con 0x7f95440cc780 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954a6c0700 1 --2- 172.21.15.5:0/1324140650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95440cc780 0x7f95440ccc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f954415ed10 tx=0x7f953c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b784d4840527c397 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f9548ebd700 1 -- 172.21.15.5:0/1324140650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00e070 con 0x7f95440cc780 2023-08-09T14:15:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f9548ebd700 1 -- 172.21.15.5:0/1324140650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c003a20 con 0x7f95440cc780 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f9548ebd700 1 -- 172.21.15.5:0/1324140650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c003dd0 con 0x7f95440cc780 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 -- 172.21.15.5:0/1324140650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95440cc780 msgr2=0x7f95440ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 --2- 172.21.15.5:0/1324140650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95440cc780 0x7f95440ccc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f954415ed10 tx=0x7f953c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 -- 172.21.15.5:0/1324140650 shutdown_connections 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 --2- 172.21.15.5:0/1324140650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95440cc780 0x7f95440ccc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 --2- 172.21.15.5:0/1324140650 >> v2:172.21.15.101:3300/0 conn(0x7f954406a1c0 0x7f954406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 -- 172.21.15.5:0/1324140650 >> 172.21.15.5:0/1324140650 conn(0x7f95440b1900 msgr2=0x7f95440b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 -- 172.21.15.5:0/1324140650 shutdown_connections 2023-08-09T14:15:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.277+0000 7f954c123700 1 -- 172.21.15.5:0/1324140650 wait complete. 2023-08-09T14:15:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 Processor -- start 2023-08-09T14:15:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 -- start start 2023-08-09T14:15:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f95440cc780 0x7f95441523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f954415d400 0x7f95440c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544160030 con 0x7f954406a1c0 2023-08-09T14:15:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544156760 con 0x7f954415d400 2023-08-09T14:15:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f954c123700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954415f420 con 0x7f95440cc780 2023-08-09T14:15:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f9549ebf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f9549ebf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42562/0 (socket says 172.21.15.5:42562) 2023-08-09T14:15:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.279+0000 7f9549ebf700 1 -- 172.21.15.5:0/2545228671 learned_addr learned my addr 172.21.15.5:0/2545228671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f95496be700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f95440cc780 0x7f95441523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f954a6c0700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f954415d400 0x7f95440c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 -- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f95440cc780 msgr2=0x7f95441523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f95440cc780 0x7f95441523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 -- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f954415d400 msgr2=0x7f95440c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f954415d400 0x7f95440c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 -- 172.21.15.5:0/2545228671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c009b30 con 0x7f954406a1c0 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f9549ebf700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f953400b470 tx=0x7f953400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534011830 con 0x7f954406a1c0 2023-08-09T14:15:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534011990 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954415f700 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534011d40 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.280+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954415fcc0 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.281+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9544074600 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.281+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f953401a400 con 0x7f954406a1c0 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.282+0000 7f953a7fc700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 0x7f952806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.282+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9534088590 con 0x7f954406a1c0 2023-08-09T14:15:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.282+0000 7f95496be700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 0x7f952806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.282+0000 7f95496be700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 0x7f952806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95441618d0 tx=0x7f9540008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.286+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9534053d10 con 0x7f954406a1c0 2023-08-09T14:15:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.480+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f954406e200 con 0x7f952806a0e0 2023-08-09T14:15:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.489+0000 7f953a7fc700 1 -- 172.21.15.5:0/2545228671 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281082 (secure 0 0 0) 0x7f954000a660 con 0x7f952806a0e0 2023-08-09T14:15:31.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 msgr2=0x7f952806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 0x7f952806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95441618d0 tx=0x7f9540008040 comp rx=0 tx=0).stop 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 msgr2=0x7f954415ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f953400b470 tx=0x7f953400b830 comp rx=0 tx=0).stop 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 shutdown_connections 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f952806a0e0 0x7f952806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f954415d400 0x7f95440c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f954406a1c0 0x7f954415ee40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 --2- 172.21.15.5:0/2545228671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f95440cc780 0x7f95441523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.492+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 >> 172.21.15.5:0/2545228671 conn(0x7f95440b1900 msgr2=0x7f95440aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.493+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 shutdown_connections 2023-08-09T14:15:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.493+0000 7f954c123700 1 -- 172.21.15.5:0/2545228671 wait complete. 2023-08-09T14:15:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:15:31.507 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-09T14:15:29.782401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218900,"kb_used_data":2696,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755820,"statfs":{"total":773094113280,"available":772869959680,"internally_reserved":0,"allocated":2760704,"data_stored":1720720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.444264"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714534+0000","last_change":"2023-08-09T14:15:27.359010+0000","last_active":"2023-08-09T14:15:28.714534+0000","last_peered":"2023-08-09T14:15:28.714534+0000","last_clean":"2023-08-09T14:15:28.714534+0000","last_became_active":"2023-08-09T14:15:27.358323+0000","last_became_peered":"2023-08-09T14:15:27.358323+0000","last_unstale":"2023-08-09T14:15:28.714534+0000","last_undegraded":"2023-08-09T14:15:28.714534+0000","last_fullsized":"2023-08-09T14:15:28.714534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:03.815478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715145+0000","last_change":"2023-08-09T14:15:27.362006+0000","last_active":"2023-08-09T14:15:28.715145+0000","last_peered":"2023-08-09T14:15:28.715145+0000","last_clean":"2023-08-09T14:15:28.715145+0000","last_became_active":"2023-08-09T14:15:27.361703+0000","last_became_peered":"2023-08-09T14:15:27.361703+0000","last_unstale":"2023-08-09T14:15:28.715145+0000","last_undegraded":"2023-08-09T14:15:28.715145+0000","last_fullsized":"2023-08-09T14:15:28.715145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365249+0000","last_change":"2023-08-09T14:15:27.374050+0000","last_active":"2023-08-09T14:15:28.365249+0000","last_peered":"2023-08-09T14:15:28.365249+0000","last_clean":"2023-08-09T14:15:28.365249+0000","last_became_active":"2023-08-09T14:15:27.373773+0000","last_became_peered":"2023-08-09T14:15:27.373773+0000","last_unstale":"2023-08-09T14:15:28.365249+0000","last_undegraded":"2023-08-09T14:15:28.365249+0000","last_fullsized":"2023-08-09T14:15:28.365249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716296+0000","last_change":"2023-08-09T14:15:27.372871+0000","last_active":"2023-08-09T14:15:28.716296+0000","last_peered":"2023-08-09T14:15:28.716296+0000","last_clean":"2023-08-09T14:15:28.716296+0000","last_became_active":"2023-08-09T14:15:27.372498+0000","last_became_peered":"2023-08-09T14:15:27.372498+0000","last_unstale":"2023-08-09T14:15:28.716296+0000","last_undegraded":"2023-08-09T14:15:28.716296+0000","last_fullsized":"2023-08-09T14:15:28.716296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714590+0000","last_change":"2023-08-09T14:15:27.358952+0000","last_active":"2023-08-09T14:15:28.714590+0000","last_peered":"2023-08-09T14:15:28.714590+0000","last_clean":"2023-08-09T14:15:28.714590+0000","last_became_active":"2023-08-09T14:15:27.357896+0000","last_became_peered":"2023-08-09T14:15:27.357896+0000","last_unstale":"2023-08-09T14:15:28.714590+0000","last_undegraded":"2023-08-09T14:15:28.714590+0000","last_fullsized":"2023-08-09T14:15:28.714590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:25.276374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714853+0000","last_change":"2023-08-09T14:15:27.358714+0000","last_active":"2023-08-09T14:15:28.714853+0000","last_peered":"2023-08-09T14:15:28.714853+0000","last_clean":"2023-08-09T14:15:28.714853+0000","last_became_active":"2023-08-09T14:15:27.358414+0000","last_became_peered":"2023-08-09T14:15:27.358414+0000","last_unstale":"2023-08-09T14:15:28.714853+0000","last_undegraded":"2023-08-09T14:15:28.714853+0000","last_fullsized":"2023-08-09T14:15:28.714853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:01.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365423+0000","last_change":"2023-08-09T14:15:27.377127+0000","last_active":"2023-08-09T14:15:28.365423+0000","last_peered":"2023-08-09T14:15:28.365423+0000","last_clean":"2023-08-09T14:15:28.365423+0000","last_became_active":"2023-08-09T14:15:27.376816+0000","last_became_peered":"2023-08-09T14:15:27.376816+0000","last_unstale":"2023-08-09T14:15:28.365423+0000","last_undegraded":"2023-08-09T14:15:28.365423+0000","last_fullsized":"2023-08-09T14:15:28.365423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715429+0000","last_change":"2023-08-09T14:15:27.372568+0000","last_active":"2023-08-09T14:15:28.715429+0000","last_peered":"2023-08-09T14:15:28.715429+0000","last_clean":"2023-08-09T14:15:28.715429+0000","last_became_active":"2023-08-09T14:15:27.372090+0000","last_became_peered":"2023-08-09T14:15:27.372090+0000","last_unstale":"2023-08-09T14:15:28.715429+0000","last_undegraded":"2023-08-09T14:15:28.715429+0000","last_fullsized":"2023-08-09T14:15:28.715429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.374336+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.374042+0000","last_became_peered":"2023-08-09T14:15:27.374042+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:59.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365339+0000","last_change":"2023-08-09T14:15:27.371398+0000","last_active":"2023-08-09T14:15:28.365339+0000","last_peered":"2023-08-09T14:15:28.365339+0000","last_clean":"2023-08-09T14:15:28.365339+0000","last_became_active":"2023-08-09T14:15:27.371094+0000","last_became_peered":"2023-08-09T14:15:27.371094+0000","last_unstale":"2023-08-09T14:15:28.365339+0000","last_undegraded":"2023-08-09T14:15:28.365339+0000","last_fullsized":"2023-08-09T14:15:28.365339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714891+0000","last_change":"2023-08-09T14:15:27.373020+0000","last_active":"2023-08-09T14:15:28.714891+0000","last_peered":"2023-08-09T14:15:28.714891+0000","last_clean":"2023-08-09T14:15:28.714891+0000","last_became_active":"2023-08-09T14:15:27.371864+0000","last_became_peered":"2023-08-09T14:15:27.371864+0000","last_unstale":"2023-08-09T14:15:28.714891+0000","last_undegraded":"2023-08-09T14:15:28.714891+0000","last_fullsized":"2023-08-09T14:15:28.714891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715197+0000","last_change":"2023-08-09T14:15:27.360056+0000","last_active":"2023-08-09T14:15:28.715197+0000","last_peered":"2023-08-09T14:15:28.715197+0000","last_clean":"2023-08-09T14:15:28.715197+0000","last_became_active":"2023-08-09T14:15:27.359789+0000","last_became_peered":"2023-08-09T14:15:27.359789+0000","last_unstale":"2023-08-09T14:15:28.715197+0000","last_undegraded":"2023-08-09T14:15:28.715197+0000","last_fullsized":"2023-08-09T14:15:28.715197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364182+0000","last_change":"2023-08-09T14:15:27.370713+0000","last_active":"2023-08-09T14:15:28.364182+0000","last_peered":"2023-08-09T14:15:28.364182+0000","last_clean":"2023-08-09T14:15:28.364182+0000","last_became_active":"2023-08-09T14:15:27.370350+0000","last_became_peered":"2023-08-09T14:15:27.370350+0000","last_unstale":"2023-08-09T14:15:28.364182+0000","last_undegraded":"2023-08-09T14:15:28.364182+0000","last_fullsized":"2023-08-09T14:15:28.364182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.376534+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.376246+0000","last_became_peered":"2023-08-09T14:15:27.376246+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363636+0000","last_change":"2023-08-09T14:15:27.371361+0000","last_active":"2023-08-09T14:15:28.363636+0000","last_peered":"2023-08-09T14:15:28.363636+0000","last_clean":"2023-08-09T14:15:28.363636+0000","last_became_active":"2023-08-09T14:15:27.371080+0000","last_became_peered":"2023-08-09T14:15:27.371080+0000","last_unstale":"2023-08-09T14:15:28.363636+0000","last_undegraded":"2023-08-09T14:15:28.363636+0000","last_fullsized":"2023-08-09T14:15:28.363636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715977+0000","last_change":"2023-08-09T14:15:27.365726+0000","last_active":"2023-08-09T14:15:28.715977+0000","last_peered":"2023-08-09T14:15:28.715977+0000","last_clean":"2023-08-09T14:15:28.715977+0000","last_became_active":"2023-08-09T14:15:27.365446+0000","last_became_peered":"2023-08-09T14:15:27.365446+0000","last_unstale":"2023-08-09T14:15:28.715977+0000","last_undegraded":"2023-08-09T14:15:28.715977+0000","last_fullsized":"2023-08-09T14:15:28.715977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363356+0000","last_change":"2023-08-09T14:15:26.366707+0000","last_active":"2023-08-09T14:15:28.363356+0000","last_peered":"2023-08-09T14:15:28.363356+0000","last_clean":"2023-08-09T14:15:28.363356+0000","last_became_active":"2023-08-09T14:15:26.366353+0000","last_became_peered":"2023-08-09T14:15:26.366353+0000","last_unstale":"2023-08-09T14:15:28.363356+0000","last_undegraded":"2023-08-09T14:15:28.363356+0000","last_fullsized":"2023-08-09T14:15:28.363356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:29.574516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715297+0000","last_change":"2023-08-09T14:15:27.368533+0000","last_active":"2023-08-09T14:15:28.715297+0000","last_peered":"2023-08-09T14:15:28.715297+0000","last_clean":"2023-08-09T14:15:28.715297+0000","last_became_active":"2023-08-09T14:15:27.368106+0000","last_became_peered":"2023-08-09T14:15:27.368106+0000","last_unstale":"2023-08-09T14:15:28.715297+0000","last_undegraded":"2023-08-09T14:15:28.715297+0000","last_fullsized":"2023-08-09T14:15:28.715297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715671+0000","last_change":"2023-08-09T14:15:26.363963+0000","last_active":"2023-08-09T14:15:28.715671+0000","last_peered":"2023-08-09T14:15:28.715671+0000","last_clean":"2023-08-09T14:15:28.715671+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715671+0000","last_undegraded":"2023-08-09T14:15:28.715671+0000","last_fullsized":"2023-08-09T14:15:28.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715542+0000","last_change":"2023-08-09T14:15:26.364578+0000","last_active":"2023-08-09T14:15:28.715542+0000","last_peered":"2023-08-09T14:15:28.715542+0000","last_clean":"2023-08-09T14:15:28.715542+0000","last_became_active":"2023-08-09T14:15:26.364070+0000","last_became_peered":"2023-08-09T14:15:26.364070+0000","last_unstale":"2023-08-09T14:15:28.715542+0000","last_undegraded":"2023-08-09T14:15:28.715542+0000","last_fullsized":"2023-08-09T14:15:28.715542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715566+0000","last_change":"2023-08-09T14:15:27.364655+0000","last_active":"2023-08-09T14:15:28.715566+0000","last_peered":"2023-08-09T14:15:28.715566+0000","last_clean":"2023-08-09T14:15:28.715566+0000","last_became_active":"2023-08-09T14:15:27.364316+0000","last_became_peered":"2023-08-09T14:15:27.364316+0000","last_unstale":"2023-08-09T14:15:28.715566+0000","last_undegraded":"2023-08-09T14:15:28.715566+0000","last_fullsized":"2023-08-09T14:15:28.715566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:02.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715749+0000","last_change":"2023-08-09T14:15:27.366627+0000","last_active":"2023-08-09T14:15:28.715749+0000","last_peered":"2023-08-09T14:15:28.715749+0000","last_clean":"2023-08-09T14:15:28.715749+0000","last_became_active":"2023-08-09T14:15:27.366355+0000","last_became_peered":"2023-08-09T14:15:27.366355+0000","last_unstale":"2023-08-09T14:15:28.715749+0000","last_undegraded":"2023-08-09T14:15:28.715749+0000","last_fullsized":"2023-08-09T14:15:28.715749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:31.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365449+0000","last_change":"2023-08-09T14:15:26.369077+0000","last_active":"2023-08-09T14:15:28.365449+0000","last_peered":"2023-08-09T14:15:28.365449+0000","last_clean":"2023-08-09T14:15:28.365449+0000","last_became_active":"2023-08-09T14:15:26.368729+0000","last_became_peered":"2023-08-09T14:15:26.368729+0000","last_unstale":"2023-08-09T14:15:28.365449+0000","last_undegraded":"2023-08-09T14:15:28.365449+0000","last_fullsized":"2023-08-09T14:15:28.365449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:31.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363694+0000","last_change":"2023-08-09T14:15:27.376850+0000","last_active":"2023-08-09T14:15:28.363694+0000","last_peered":"2023-08-09T14:15:28.363694+0000","last_clean":"2023-08-09T14:15:28.363694+0000","last_became_active":"2023-08-09T14:15:27.376373+0000","last_became_peered":"2023-08-09T14:15:27.376373+0000","last_unstale":"2023-08-09T14:15:28.363694+0000","last_undegraded":"2023-08-09T14:15:28.363694+0000","last_fullsized":"2023-08-09T14:15:28.363694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365182+0000","last_change":"2023-08-09T14:15:26.359070+0000","last_active":"2023-08-09T14:15:28.365182+0000","last_peered":"2023-08-09T14:15:28.365182+0000","last_clean":"2023-08-09T14:15:28.365182+0000","last_became_active":"2023-08-09T14:15:26.357308+0000","last_became_peered":"2023-08-09T14:15:26.357308+0000","last_unstale":"2023-08-09T14:15:28.365182+0000","last_undegraded":"2023-08-09T14:15:28.365182+0000","last_fullsized":"2023-08-09T14:15:28.365182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715653+0000","last_change":"2023-08-09T14:15:27.373211+0000","last_active":"2023-08-09T14:15:28.715653+0000","last_peered":"2023-08-09T14:15:28.715653+0000","last_clean":"2023-08-09T14:15:28.715653+0000","last_became_active":"2023-08-09T14:15:27.372904+0000","last_became_peered":"2023-08-09T14:15:27.372904+0000","last_unstale":"2023-08-09T14:15:28.715653+0000","last_undegraded":"2023-08-09T14:15:28.715653+0000","last_fullsized":"2023-08-09T14:15:28.715653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714978+0000","last_change":"2023-08-09T14:15:26.365445+0000","last_active":"2023-08-09T14:15:28.714978+0000","last_peered":"2023-08-09T14:15:28.714978+0000","last_clean":"2023-08-09T14:15:28.714978+0000","last_became_active":"2023-08-09T14:15:26.365146+0000","last_became_peered":"2023-08-09T14:15:26.365146+0000","last_unstale":"2023-08-09T14:15:28.714978+0000","last_undegraded":"2023-08-09T14:15:28.714978+0000","last_fullsized":"2023-08-09T14:15:28.714978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365331+0000","last_change":"2023-08-09T14:15:26.362477+0000","last_active":"2023-08-09T14:15:28.365331+0000","last_peered":"2023-08-09T14:15:28.365331+0000","last_clean":"2023-08-09T14:15:28.365331+0000","last_became_active":"2023-08-09T14:15:26.362201+0000","last_became_peered":"2023-08-09T14:15:26.362201+0000","last_unstale":"2023-08-09T14:15:28.365331+0000","last_undegraded":"2023-08-09T14:15:28.365331+0000","last_fullsized":"2023-08-09T14:15:28.365331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715086+0000","last_change":"2023-08-09T14:15:27.368351+0000","last_active":"2023-08-09T14:15:28.715086+0000","last_peered":"2023-08-09T14:15:28.715086+0000","last_clean":"2023-08-09T14:15:28.715086+0000","last_became_active":"2023-08-09T14:15:27.367354+0000","last_became_peered":"2023-08-09T14:15:27.367354+0000","last_unstale":"2023-08-09T14:15:28.715086+0000","last_undegraded":"2023-08-09T14:15:28.715086+0000","last_fullsized":"2023-08-09T14:15:28.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716271+0000","last_change":"2023-08-09T14:15:27.367007+0000","last_active":"2023-08-09T14:15:28.716271+0000","last_peered":"2023-08-09T14:15:28.716271+0000","last_clean":"2023-08-09T14:15:28.716271+0000","last_became_active":"2023-08-09T14:15:27.366701+0000","last_became_peered":"2023-08-09T14:15:27.366701+0000","last_unstale":"2023-08-09T14:15:28.716271+0000","last_undegraded":"2023-08-09T14:15:28.716271+0000","last_fullsized":"2023-08-09T14:15:28.716271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364911+0000","last_change":"2023-08-09T14:15:26.358111+0000","last_active":"2023-08-09T14:15:28.364911+0000","last_peered":"2023-08-09T14:15:28.364911+0000","last_clean":"2023-08-09T14:15:28.364911+0000","last_became_active":"2023-08-09T14:15:26.357775+0000","last_became_peered":"2023-08-09T14:15:26.357775+0000","last_unstale":"2023-08-09T14:15:28.364911+0000","last_undegraded":"2023-08-09T14:15:28.364911+0000","last_fullsized":"2023-08-09T14:15:28.364911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:02.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364888+0000","last_change":"2023-08-09T14:15:26.356264+0000","last_active":"2023-08-09T14:15:28.364888+0000","last_peered":"2023-08-09T14:15:28.364888+0000","last_clean":"2023-08-09T14:15:28.364888+0000","last_became_active":"2023-08-09T14:15:26.355974+0000","last_became_peered":"2023-08-09T14:15:26.355974+0000","last_unstale":"2023-08-09T14:15:28.364888+0000","last_undegraded":"2023-08-09T14:15:28.364888+0000","last_fullsized":"2023-08-09T14:15:28.364888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365252+0000","last_change":"2023-08-09T14:15:26.359582+0000","last_active":"2023-08-09T14:15:28.365252+0000","last_peered":"2023-08-09T14:15:28.365252+0000","last_clean":"2023-08-09T14:15:28.365252+0000","last_became_active":"2023-08-09T14:15:26.358709+0000","last_became_peered":"2023-08-09T14:15:26.358709+0000","last_unstale":"2023-08-09T14:15:28.365252+0000","last_undegraded":"2023-08-09T14:15:28.365252+0000","last_fullsized":"2023-08-09T14:15:28.365252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:37.757503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714818+0000","last_change":"2023-08-09T14:15:27.377369+0000","last_active":"2023-08-09T14:15:28.714818+0000","last_peered":"2023-08-09T14:15:28.714818+0000","last_clean":"2023-08-09T14:15:28.714818+0000","last_became_active":"2023-08-09T14:15:27.376969+0000","last_became_peered":"2023-08-09T14:15:27.376969+0000","last_unstale":"2023-08-09T14:15:28.714818+0000","last_undegraded":"2023-08-09T14:15:28.714818+0000","last_fullsized":"2023-08-09T14:15:28.714818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715897+0000","last_change":"2023-08-09T14:15:26.365316+0000","last_active":"2023-08-09T14:15:28.715897+0000","last_peered":"2023-08-09T14:15:28.715897+0000","last_clean":"2023-08-09T14:15:28.715897+0000","last_became_active":"2023-08-09T14:15:26.365027+0000","last_became_peered":"2023-08-09T14:15:26.365027+0000","last_unstale":"2023-08-09T14:15:28.715897+0000","last_undegraded":"2023-08-09T14:15:28.715897+0000","last_fullsized":"2023-08-09T14:15:28.715897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715405+0000","last_change":"2023-08-09T14:15:26.363414+0000","last_active":"2023-08-09T14:15:28.715405+0000","last_peered":"2023-08-09T14:15:28.715405+0000","last_clean":"2023-08-09T14:15:28.715405+0000","last_became_active":"2023-08-09T14:15:26.363094+0000","last_became_peered":"2023-08-09T14:15:26.363094+0000","last_unstale":"2023-08-09T14:15:28.715405+0000","last_undegraded":"2023-08-09T14:15:28.715405+0000","last_fullsized":"2023-08-09T14:15:28.715405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:32.261834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363815+0000","last_change":"2023-08-09T14:15:27.358343+0000","last_active":"2023-08-09T14:15:28.363815+0000","last_peered":"2023-08-09T14:15:28.363815+0000","last_clean":"2023-08-09T14:15:28.363815+0000","last_became_active":"2023-08-09T14:15:27.358044+0000","last_became_peered":"2023-08-09T14:15:27.358044+0000","last_unstale":"2023-08-09T14:15:28.363815+0000","last_undegraded":"2023-08-09T14:15:28.363815+0000","last_fullsized":"2023-08-09T14:15:28.363815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716164+0000","last_change":"2023-08-09T14:15:26.358191+0000","last_active":"2023-08-09T14:15:28.716164+0000","last_peered":"2023-08-09T14:15:28.716164+0000","last_clean":"2023-08-09T14:15:28.716164+0000","last_became_active":"2023-08-09T14:15:26.357725+0000","last_became_peered":"2023-08-09T14:15:26.357725+0000","last_unstale":"2023-08-09T14:15:28.716164+0000","last_undegraded":"2023-08-09T14:15:28.716164+0000","last_fullsized":"2023-08-09T14:15:28.716164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-09T14:15:22.399610+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:15:22.399610+0000","last_peered":"2023-08-09T14:15:22.399610+0000","last_clean":"2023-08-09T14:15:22.399610+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:15:22.399610+0000","last_undegraded":"2023-08-09T14:15:22.399610+0000","last_fullsized":"2023-08-09T14:15:22.399610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:43:30.705194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715537+0000","last_change":"2023-08-09T14:15:27.370345+0000","last_active":"2023-08-09T14:15:28.715537+0000","last_peered":"2023-08-09T14:15:28.715537+0000","last_clean":"2023-08-09T14:15:28.715537+0000","last_became_active":"2023-08-09T14:15:27.370097+0000","last_became_peered":"2023-08-09T14:15:27.370097+0000","last_unstale":"2023-08-09T14:15:28.715537+0000","last_undegraded":"2023-08-09T14:15:28.715537+0000","last_fullsized":"2023-08-09T14:15:28.715537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715740+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:15:28.715740+0000","last_peered":"2023-08-09T14:15:28.715740+0000","last_clean":"2023-08-09T14:15:28.715740+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:15:28.715740+0000","last_undegraded":"2023-08-09T14:15:28.715740+0000","last_fullsized":"2023-08-09T14:15:28.715740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:49.358632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715336+0000","last_change":"2023-08-09T14:15:26.362381+0000","last_active":"2023-08-09T14:15:28.715336+0000","last_peered":"2023-08-09T14:15:28.715336+0000","last_clean":"2023-08-09T14:15:28.715336+0000","last_became_active":"2023-08-09T14:15:26.362034+0000","last_became_peered":"2023-08-09T14:15:26.362034+0000","last_unstale":"2023-08-09T14:15:28.715336+0000","last_undegraded":"2023-08-09T14:15:28.715336+0000","last_fullsized":"2023-08-09T14:15:28.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363416+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:15:28.363416+0000","last_peered":"2023-08-09T14:15:28.363416+0000","last_clean":"2023-08-09T14:15:28.363416+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:15:28.363416+0000","last_undegraded":"2023-08-09T14:15:28.363416+0000","last_fullsized":"2023-08-09T14:15:28.363416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:16.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364505+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:15:28.364505+0000","last_peered":"2023-08-09T14:15:28.364505+0000","last_clean":"2023-08-09T14:15:28.364505+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:15:28.364505+0000","last_undegraded":"2023-08-09T14:15:28.364505+0000","last_fullsized":"2023-08-09T14:15:28.364505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:25.028342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714831+0000","last_change":"2023-08-09T14:15:26.359463+0000","last_active":"2023-08-09T14:15:28.714831+0000","last_peered":"2023-08-09T14:15:28.714831+0000","last_clean":"2023-08-09T14:15:28.714831+0000","last_became_active":"2023-08-09T14:15:26.359089+0000","last_became_peered":"2023-08-09T14:15:26.359089+0000","last_unstale":"2023-08-09T14:15:28.714831+0000","last_undegraded":"2023-08-09T14:15:28.714831+0000","last_fullsized":"2023-08-09T14:15:28.714831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:21.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715221+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715221+0000","last_peered":"2023-08-09T14:15:28.715221+0000","last_clean":"2023-08-09T14:15:28.715221+0000","last_became_active":"2023-08-09T14:15:27.377030+0000","last_became_peered":"2023-08-09T14:15:27.377030+0000","last_unstale":"2023-08-09T14:15:28.715221+0000","last_undegraded":"2023-08-09T14:15:28.715221+0000","last_fullsized":"2023-08-09T14:15:28.715221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364475+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:15:28.364475+0000","last_peered":"2023-08-09T14:15:28.364475+0000","last_clean":"2023-08-09T14:15:28.364475+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:15:28.364475+0000","last_undegraded":"2023-08-09T14:15:28.364475+0000","last_fullsized":"2023-08-09T14:15:28.364475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:58.636275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363246+0000","last_change":"2023-08-09T14:15:26.370171+0000","last_active":"2023-08-09T14:15:28.363246+0000","last_peered":"2023-08-09T14:15:28.363246+0000","last_clean":"2023-08-09T14:15:28.363246+0000","last_became_active":"2023-08-09T14:15:26.369702+0000","last_became_peered":"2023-08-09T14:15:26.369702+0000","last_unstale":"2023-08-09T14:15:28.363246+0000","last_undegraded":"2023-08-09T14:15:28.363246+0000","last_fullsized":"2023-08-09T14:15:28.363246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:33.713389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363721+0000","last_change":"2023-08-09T14:15:27.365430+0000","last_active":"2023-08-09T14:15:28.363721+0000","last_peered":"2023-08-09T14:15:28.363721+0000","last_clean":"2023-08-09T14:15:28.363721+0000","last_became_active":"2023-08-09T14:15:27.365151+0000","last_became_peered":"2023-08-09T14:15:27.365151+0000","last_unstale":"2023-08-09T14:15:28.363721+0000","last_undegraded":"2023-08-09T14:15:28.363721+0000","last_fullsized":"2023-08-09T14:15:28.363721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363905+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:15:28.363905+0000","last_peered":"2023-08-09T14:15:28.363905+0000","last_clean":"2023-08-09T14:15:28.363905+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.363905+0000","last_undegraded":"2023-08-09T14:15:28.363905+0000","last_fullsized":"2023-08-09T14:15:28.363905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.854209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715456+0000","last_change":"2023-08-09T14:15:26.358773+0000","last_active":"2023-08-09T14:15:28.715456+0000","last_peered":"2023-08-09T14:15:28.715456+0000","last_clean":"2023-08-09T14:15:28.715456+0000","last_became_active":"2023-08-09T14:15:26.358468+0000","last_became_peered":"2023-08-09T14:15:26.358468+0000","last_unstale":"2023-08-09T14:15:28.715456+0000","last_undegraded":"2023-08-09T14:15:28.715456+0000","last_fullsized":"2023-08-09T14:15:28.715456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:44.991430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-09T14:15:23.526725+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:15:23.526725+0000","last_peered":"2023-08-09T14:15:23.526725+0000","last_clean":"2023-08-09T14:15:23.526725+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:23.526725+0000","last_undegraded":"2023-08-09T14:15:23.526725+0000","last_fullsized":"2023-08-09T14:15:23.526725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:59:06.034366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363792+0000","last_change":"2023-08-09T14:15:27.367876+0000","last_active":"2023-08-09T14:15:28.363792+0000","last_peered":"2023-08-09T14:15:28.363792+0000","last_clean":"2023-08-09T14:15:28.363792+0000","last_became_active":"2023-08-09T14:15:27.367423+0000","last_became_peered":"2023-08-09T14:15:27.367423+0000","last_unstale":"2023-08-09T14:15:28.363792+0000","last_undegraded":"2023-08-09T14:15:28.363792+0000","last_fullsized":"2023-08-09T14:15:28.363792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-09T14:15:23.025995+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:15:23.025995+0000","last_peered":"2023-08-09T14:15:23.025995+0000","last_clean":"2023-08-09T14:15:23.025995+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:15:23.025995+0000","last_undegraded":"2023-08-09T14:15:23.025995+0000","last_fullsized":"2023-08-09T14:15:23.025995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:59:06.034366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363714+0000","last_change":"2023-08-09T14:15:26.369783+0000","last_active":"2023-08-09T14:15:28.363714+0000","last_peered":"2023-08-09T14:15:28.363714+0000","last_clean":"2023-08-09T14:15:28.363714+0000","last_became_active":"2023-08-09T14:15:26.369470+0000","last_became_peered":"2023-08-09T14:15:26.369470+0000","last_unstale":"2023-08-09T14:15:28.363714+0000","last_undegraded":"2023-08-09T14:15:28.363714+0000","last_fullsized":"2023-08-09T14:15:28.363714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:05.002240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715142+0000","last_change":"2023-08-09T14:15:27.369319+0000","last_active":"2023-08-09T14:15:28.715142+0000","last_peered":"2023-08-09T14:15:28.715142+0000","last_clean":"2023-08-09T14:15:28.715142+0000","last_became_active":"2023-08-09T14:15:27.369020+0000","last_became_peered":"2023-08-09T14:15:27.369020+0000","last_unstale":"2023-08-09T14:15:28.715142+0000","last_undegraded":"2023-08-09T14:15:28.715142+0000","last_fullsized":"2023-08-09T14:15:28.715142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-09T14:15:23.025999+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:15:23.025999+0000","last_peered":"2023-08-09T14:15:23.025999+0000","last_clean":"2023-08-09T14:15:23.025999+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:15:23.025999+0000","last_undegraded":"2023-08-09T14:15:23.025999+0000","last_fullsized":"2023-08-09T14:15:23.025999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:11:09.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363514+0000","last_change":"2023-08-09T14:15:27.364616+0000","last_active":"2023-08-09T14:15:28.363514+0000","last_peered":"2023-08-09T14:15:28.363514+0000","last_clean":"2023-08-09T14:15:28.363514+0000","last_became_active":"2023-08-09T14:15:27.364247+0000","last_became_peered":"2023-08-09T14:15:27.364247+0000","last_unstale":"2023-08-09T14:15:28.363514+0000","last_undegraded":"2023-08-09T14:15:28.363514+0000","last_fullsized":"2023-08-09T14:15:28.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714984+0000","last_change":"2023-08-09T14:15:26.358586+0000","last_active":"2023-08-09T14:15:28.714984+0000","last_peered":"2023-08-09T14:15:28.714984+0000","last_clean":"2023-08-09T14:15:28.714984+0000","last_became_active":"2023-08-09T14:15:26.358267+0000","last_became_peered":"2023-08-09T14:15:26.358267+0000","last_unstale":"2023-08-09T14:15:28.714984+0000","last_undegraded":"2023-08-09T14:15:28.714984+0000","last_fullsized":"2023-08-09T14:15:28.714984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:32.171526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714879+0000","last_change":"2023-08-09T14:15:27.373217+0000","last_active":"2023-08-09T14:15:28.714879+0000","last_peered":"2023-08-09T14:15:28.714879+0000","last_clean":"2023-08-09T14:15:28.714879+0000","last_became_active":"2023-08-09T14:15:27.372954+0000","last_became_peered":"2023-08-09T14:15:27.372954+0000","last_unstale":"2023-08-09T14:15:28.714879+0000","last_undegraded":"2023-08-09T14:15:28.714879+0000","last_fullsized":"2023-08-09T14:15:28.714879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:01.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:25.332442+0000","last_change":"2023-08-09T14:15:25.332442+0000","last_active":"2023-08-09T14:15:25.332442+0000","last_peered":"2023-08-09T14:15:25.332442+0000","last_clean":"2023-08-09T14:15:25.332442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:25.332442+0000","last_undegraded":"2023-08-09T14:15:25.332442+0000","last_fullsized":"2023-08-09T14:15:25.332442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715832+0000","last_change":"2023-08-09T14:15:26.368865+0000","last_active":"2023-08-09T14:15:28.715832+0000","last_peered":"2023-08-09T14:15:28.715832+0000","last_clean":"2023-08-09T14:15:28.715832+0000","last_became_active":"2023-08-09T14:15:26.368589+0000","last_became_peered":"2023-08-09T14:15:26.368589+0000","last_unstale":"2023-08-09T14:15:28.715832+0000","last_undegraded":"2023-08-09T14:15:28.715832+0000","last_fullsized":"2023-08-09T14:15:28.715832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:03.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715545+0000","last_change":"2023-08-09T14:15:27.358450+0000","last_active":"2023-08-09T14:15:28.715545+0000","last_peered":"2023-08-09T14:15:28.715545+0000","last_clean":"2023-08-09T14:15:28.715545+0000","last_became_active":"2023-08-09T14:15:27.358162+0000","last_became_peered":"2023-08-09T14:15:27.358162+0000","last_unstale":"2023-08-09T14:15:28.715545+0000","last_undegraded":"2023-08-09T14:15:28.715545+0000","last_fullsized":"2023-08-09T14:15:28.715545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715668+0000","last_change":"2023-08-09T14:15:26.364373+0000","last_active":"2023-08-09T14:15:28.715668+0000","last_peered":"2023-08-09T14:15:28.715668+0000","last_clean":"2023-08-09T14:15:28.715668+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715668+0000","last_undegraded":"2023-08-09T14:15:28.715668+0000","last_fullsized":"2023-08-09T14:15:28.715668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715351+0000","last_change":"2023-08-09T14:15:27.369804+0000","last_active":"2023-08-09T14:15:28.715351+0000","last_peered":"2023-08-09T14:15:28.715351+0000","last_clean":"2023-08-09T14:15:28.715351+0000","last_became_active":"2023-08-09T14:15:27.369506+0000","last_became_peered":"2023-08-09T14:15:27.369506+0000","last_unstale":"2023-08-09T14:15:28.715351+0000","last_undegraded":"2023-08-09T14:15:28.715351+0000","last_fullsized":"2023-08-09T14:15:28.715351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:15:26.337937+0000","last_change":"2023-08-09T14:15:26.337937+0000","last_active":"2023-08-09T14:15:26.337937+0000","last_peered":"2023-08-09T14:15:26.337937+0000","last_clean":"2023-08-09T14:15:26.337937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:15:26.337937+0000","last_undegraded":"2023-08-09T14:15:26.337937+0000","last_fullsized":"2023-08-09T14:15:26.337937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715801+0000","last_change":"2023-08-09T14:15:27.371728+0000","last_active":"2023-08-09T14:15:28.715801+0000","last_peered":"2023-08-09T14:15:28.715801+0000","last_clean":"2023-08-09T14:15:28.715801+0000","last_became_active":"2023-08-09T14:15:27.371196+0000","last_became_peered":"2023-08-09T14:15:27.371196+0000","last_unstale":"2023-08-09T14:15:28.715801+0000","last_undegraded":"2023-08-09T14:15:28.715801+0000","last_fullsized":"2023-08-09T14:15:28.715801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.367662+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.366977+0000","last_became_peered":"2023-08-09T14:15:27.366977+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":42,"acting":42,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":51688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":50577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":668627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.825}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.778}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3889999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":77238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":51688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:15:31.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:15:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.670+0000 7f8cfb02a700 1 Processor -- start 2023-08-09T14:15:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.670+0000 7f8cfb02a700 1 -- start start 2023-08-09T14:15:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cfb02a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f8cf40b2130 0x7f8cf40d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cfb02a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8cf40b04f0 0x7f8cf40b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cfb02a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf40d0760 con 0x7f8cf415d5d0 2023-08-09T14:15:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cfb02a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf40b00d0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cfb02a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf40ce7f0 con 0x7f8cf40b2130 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8cf40b04f0 0x7f8cf40b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8cf40b04f0 0x7f8cf40b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42574/0 (socket says 172.21.15.5:42574) 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 -- 172.21.15.5:0/2916107952 learned_addr learned my addr 172.21.15.5:0/2916107952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf3fff700 1 --2- 172.21.15.5:0/2916107952 >> v2:172.21.15.101:3300/0 conn(0x7f8cf40b2130 0x7f8cf40d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 -- 172.21.15.5:0/2916107952 >> v2:172.21.15.101:3300/0 conn(0x7f8cf40b2130 msgr2=0x7f8cf40d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 --2- 172.21.15.5:0/2916107952 >> v2:172.21.15.101:3300/0 conn(0x7f8cf40b2130 0x7f8cf40d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 -- 172.21.15.5:0/2916107952 >> v1:172.21.15.101:6789/0 conn(0x7f8cf415d5d0 legacy=0x7f8cf40d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 -- 172.21.15.5:0/2916107952 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40afd60 con 0x7f8cf40b04f0 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.671+0000 7f8cf95c7700 1 --2- 172.21.15.5:0/2916107952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf40b0900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cf408d300 tx=0x7f8cec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3182930a2138502 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cf37fe700 1 -- 172.21.15.5:0/2916107952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00e070 con 0x7f8cf40b04f0 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cf37fe700 1 -- 172.21.15.5:0/2916107952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00b9c0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cf37fe700 1 -- 172.21.15.5:0/2916107952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00bd70 con 0x7f8cf40b04f0 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 -- 172.21.15.5:0/2916107952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 msgr2=0x7f8cf40b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/2916107952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf40b0900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cf408d300 tx=0x7f8cec00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 -- 172.21.15.5:0/2916107952 shutdown_connections 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/2916107952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf40b0900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/2916107952 >> v2:172.21.15.101:3300/0 conn(0x7f8cf40b2130 0x7f8cf40d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 -- 172.21.15.5:0/2916107952 >> 172.21.15.5:0/2916107952 conn(0x7f8cf40d3090 msgr2=0x7f8cf40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 -- 172.21.15.5:0/2916107952 shutdown_connections 2023-08-09T14:15:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.672+0000 7f8cfb02a700 1 -- 172.21.15.5:0/2916107952 wait complete. 2023-08-09T14:15:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.673+0000 7f8cfb02a700 1 Processor -- start 2023-08-09T14:15:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.673+0000 7f8cfb02a700 1 -- start start 2023-08-09T14:15:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8cf40b2130 0x7f8cf40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8cf415d5d0 0x7f8cf40cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40cbc60 con 0x7f8cf40b04f0 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40cb980 con 0x7f8cf40b2130 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cfb02a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40b5de0 con 0x7f8cf415d5d0 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cf8dc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cf8dc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42576/0 (socket says 172.21.15.5:42576) 2023-08-09T14:15:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cf8dc6700 1 -- 172.21.15.5:0/3348344958 learned_addr learned my addr 172.21.15.5:0/3348344958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.674+0000 7f8cf3fff700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8cf40b2130 0x7f8cf40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf95c7700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8cf415d5d0 0x7f8cf40cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 -- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8cf415d5d0 msgr2=0x7f8cf40cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8cf415d5d0 0x7f8cf40cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 -- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8cf40b2130 msgr2=0x7f8cf40cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8cf40b2130 0x7f8cf40cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 -- 172.21.15.5:0/3348344958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec009b30 con 0x7f8cf40b04f0 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf8dc6700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c4e0 tx=0x7f8ce800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80052d0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8005430 con 0x7f8cf40b04f0 2023-08-09T14:15:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf40b60c0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80038c0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.675+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf41f2c60 con 0x7f8cf40b04f0 2023-08-09T14:15:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.676+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf40b65e0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.677+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ce8003a20 con 0x7f8cf40b04f0 2023-08-09T14:15:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.677+0000 7f8cf17fa700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 0x7f8cd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.677+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ce8087880 con 0x7f8cf40b04f0 2023-08-09T14:15:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.677+0000 7f8cf3fff700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 0x7f8cd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.678+0000 7f8cf3fff700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 0x7f8cd806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cf41f6370 tx=0x7f8ce0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.681+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8cf40b65e0 con 0x7f8cf40b04f0 2023-08-09T14:15:31.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.874+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cf40ced20 con 0x7f8cd806a0e0 2023-08-09T14:15:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.882+0000 7f8cf17fa700 1 -- 172.21.15.5:0/3348344958 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286951 (secure 0 0 0) 0x7f8ce00076b0 con 0x7f8cd806a0e0 2023-08-09T14:15:31.888 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 msgr2=0x7f8cd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 0x7f8cd806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cf41f6370 tx=0x7f8ce0008040 comp rx=0 tx=0).stop 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 msgr2=0x7f8cf41f2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c4e0 tx=0x7f8ce800c7f0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 shutdown_connections 2023-08-09T14:15:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f8cd806a0e0 0x7f8cd806c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8cf415d5d0 0x7f8cf40cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cf40b04f0 0x7f8cf41f2720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 --2- 172.21.15.5:0/3348344958 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8cf40b2130 0x7f8cf40cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.885+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 >> 172.21.15.5:0/3348344958 conn(0x7f8cf40d3090 msgr2=0x7f8cf40d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.886+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 shutdown_connections 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:31.886+0000 7f8cfb02a700 1 -- 172.21.15.5:0/3348344958 wait complete. 2023-08-09T14:15:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:15:31.900 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-09T14:15:31.782926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219088,"kb_used_data":2868,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755632,"statfs":{"total":773094113280,"available":772869767168,"internally_reserved":0,"allocated":2936832,"data_stored":1802753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001435"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714534+0000","last_change":"2023-08-09T14:15:27.359010+0000","last_active":"2023-08-09T14:15:28.714534+0000","last_peered":"2023-08-09T14:15:28.714534+0000","last_clean":"2023-08-09T14:15:28.714534+0000","last_became_active":"2023-08-09T14:15:27.358323+0000","last_became_peered":"2023-08-09T14:15:27.358323+0000","last_unstale":"2023-08-09T14:15:28.714534+0000","last_undegraded":"2023-08-09T14:15:28.714534+0000","last_fullsized":"2023-08-09T14:15:28.714534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:03.815478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714970+0000","last_change":"2023-08-09T14:15:27.367989+0000","last_active":"2023-08-09T14:15:28.714970+0000","last_peered":"2023-08-09T14:15:28.714970+0000","last_clean":"2023-08-09T14:15:28.714970+0000","last_became_active":"2023-08-09T14:15:27.367673+0000","last_became_peered":"2023-08-09T14:15:27.367673+0000","last_unstale":"2023-08-09T14:15:28.714970+0000","last_undegraded":"2023-08-09T14:15:28.714970+0000","last_fullsized":"2023-08-09T14:15:28.714970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364961+0000","last_change":"2023-08-09T14:15:27.363689+0000","last_active":"2023-08-09T14:15:28.364961+0000","last_peered":"2023-08-09T14:15:28.364961+0000","last_clean":"2023-08-09T14:15:28.364961+0000","last_became_active":"2023-08-09T14:15:27.362860+0000","last_became_peered":"2023-08-09T14:15:27.362860+0000","last_unstale":"2023-08-09T14:15:28.364961+0000","last_undegraded":"2023-08-09T14:15:28.364961+0000","last_fullsized":"2023-08-09T14:15:28.364961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714809+0000","last_change":"2023-08-09T14:15:27.373792+0000","last_active":"2023-08-09T14:15:28.714809+0000","last_peered":"2023-08-09T14:15:28.714809+0000","last_clean":"2023-08-09T14:15:28.714809+0000","last_became_active":"2023-08-09T14:15:27.373509+0000","last_became_peered":"2023-08-09T14:15:27.373509+0000","last_unstale":"2023-08-09T14:15:28.714809+0000","last_undegraded":"2023-08-09T14:15:28.714809+0000","last_fullsized":"2023-08-09T14:15:28.714809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:22.780067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715145+0000","last_change":"2023-08-09T14:15:27.362006+0000","last_active":"2023-08-09T14:15:28.715145+0000","last_peered":"2023-08-09T14:15:28.715145+0000","last_clean":"2023-08-09T14:15:28.715145+0000","last_became_active":"2023-08-09T14:15:27.361703+0000","last_became_peered":"2023-08-09T14:15:27.361703+0000","last_unstale":"2023-08-09T14:15:28.715145+0000","last_undegraded":"2023-08-09T14:15:28.715145+0000","last_fullsized":"2023-08-09T14:15:28.715145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363995+0000","last_change":"2023-08-09T14:15:27.368188+0000","last_active":"2023-08-09T14:15:28.363995+0000","last_peered":"2023-08-09T14:15:28.363995+0000","last_clean":"2023-08-09T14:15:28.363995+0000","last_became_active":"2023-08-09T14:15:27.367964+0000","last_became_peered":"2023-08-09T14:15:27.367964+0000","last_unstale":"2023-08-09T14:15:28.363995+0000","last_undegraded":"2023-08-09T14:15:28.363995+0000","last_fullsized":"2023-08-09T14:15:28.363995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365249+0000","last_change":"2023-08-09T14:15:27.374050+0000","last_active":"2023-08-09T14:15:28.365249+0000","last_peered":"2023-08-09T14:15:28.365249+0000","last_clean":"2023-08-09T14:15:28.365249+0000","last_became_active":"2023-08-09T14:15:27.373773+0000","last_became_peered":"2023-08-09T14:15:27.373773+0000","last_unstale":"2023-08-09T14:15:28.365249+0000","last_undegraded":"2023-08-09T14:15:28.365249+0000","last_fullsized":"2023-08-09T14:15:28.365249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714972+0000","last_change":"2023-08-09T14:15:27.363180+0000","last_active":"2023-08-09T14:15:28.714972+0000","last_peered":"2023-08-09T14:15:28.714972+0000","last_clean":"2023-08-09T14:15:28.714972+0000","last_became_active":"2023-08-09T14:15:27.362900+0000","last_became_peered":"2023-08-09T14:15:27.362900+0000","last_unstale":"2023-08-09T14:15:28.714972+0000","last_undegraded":"2023-08-09T14:15:28.714972+0000","last_fullsized":"2023-08-09T14:15:28.714972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716296+0000","last_change":"2023-08-09T14:15:27.372871+0000","last_active":"2023-08-09T14:15:28.716296+0000","last_peered":"2023-08-09T14:15:28.716296+0000","last_clean":"2023-08-09T14:15:28.716296+0000","last_became_active":"2023-08-09T14:15:27.372498+0000","last_became_peered":"2023-08-09T14:15:27.372498+0000","last_unstale":"2023-08-09T14:15:28.716296+0000","last_undegraded":"2023-08-09T14:15:28.716296+0000","last_fullsized":"2023-08-09T14:15:28.716296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715540+0000","last_change":"2023-08-09T14:15:27.371102+0000","last_active":"2023-08-09T14:15:28.715540+0000","last_peered":"2023-08-09T14:15:28.715540+0000","last_clean":"2023-08-09T14:15:28.715540+0000","last_became_active":"2023-08-09T14:15:27.369324+0000","last_became_peered":"2023-08-09T14:15:27.369324+0000","last_unstale":"2023-08-09T14:15:28.715540+0000","last_undegraded":"2023-08-09T14:15:28.715540+0000","last_fullsized":"2023-08-09T14:15:28.715540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365879+0000","last_change":"2023-08-09T14:15:27.365332+0000","last_active":"2023-08-09T14:15:28.365879+0000","last_peered":"2023-08-09T14:15:28.365879+0000","last_clean":"2023-08-09T14:15:28.365879+0000","last_became_active":"2023-08-09T14:15:27.365006+0000","last_became_peered":"2023-08-09T14:15:27.365006+0000","last_unstale":"2023-08-09T14:15:28.365879+0000","last_undegraded":"2023-08-09T14:15:28.365879+0000","last_fullsized":"2023-08-09T14:15:28.365879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:30.980568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714590+0000","last_change":"2023-08-09T14:15:27.358952+0000","last_active":"2023-08-09T14:15:28.714590+0000","last_peered":"2023-08-09T14:15:28.714590+0000","last_clean":"2023-08-09T14:15:28.714590+0000","last_became_active":"2023-08-09T14:15:27.357896+0000","last_became_peered":"2023-08-09T14:15:27.357896+0000","last_unstale":"2023-08-09T14:15:28.714590+0000","last_undegraded":"2023-08-09T14:15:28.714590+0000","last_fullsized":"2023-08-09T14:15:28.714590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:25.276374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714853+0000","last_change":"2023-08-09T14:15:27.358714+0000","last_active":"2023-08-09T14:15:28.714853+0000","last_peered":"2023-08-09T14:15:28.714853+0000","last_clean":"2023-08-09T14:15:28.714853+0000","last_became_active":"2023-08-09T14:15:27.358414+0000","last_became_peered":"2023-08-09T14:15:27.358414+0000","last_unstale":"2023-08-09T14:15:28.714853+0000","last_undegraded":"2023-08-09T14:15:28.714853+0000","last_fullsized":"2023-08-09T14:15:28.714853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:01.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715151+0000","last_change":"2023-08-09T14:15:27.368320+0000","last_active":"2023-08-09T14:15:28.715151+0000","last_peered":"2023-08-09T14:15:28.715151+0000","last_clean":"2023-08-09T14:15:28.715151+0000","last_became_active":"2023-08-09T14:15:27.368012+0000","last_became_peered":"2023-08-09T14:15:27.368012+0000","last_unstale":"2023-08-09T14:15:28.715151+0000","last_undegraded":"2023-08-09T14:15:28.715151+0000","last_fullsized":"2023-08-09T14:15:28.715151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365423+0000","last_change":"2023-08-09T14:15:27.377127+0000","last_active":"2023-08-09T14:15:28.365423+0000","last_peered":"2023-08-09T14:15:28.365423+0000","last_clean":"2023-08-09T14:15:28.365423+0000","last_became_active":"2023-08-09T14:15:27.376816+0000","last_became_peered":"2023-08-09T14:15:27.376816+0000","last_unstale":"2023-08-09T14:15:28.365423+0000","last_undegraded":"2023-08-09T14:15:28.365423+0000","last_fullsized":"2023-08-09T14:15:28.365423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364162+0000","last_change":"2023-08-09T14:15:27.368513+0000","last_active":"2023-08-09T14:15:28.364162+0000","last_peered":"2023-08-09T14:15:28.364162+0000","last_clean":"2023-08-09T14:15:28.364162+0000","last_became_active":"2023-08-09T14:15:27.368213+0000","last_became_peered":"2023-08-09T14:15:27.368213+0000","last_unstale":"2023-08-09T14:15:28.364162+0000","last_undegraded":"2023-08-09T14:15:28.364162+0000","last_fullsized":"2023-08-09T14:15:28.364162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715429+0000","last_change":"2023-08-09T14:15:27.372568+0000","last_active":"2023-08-09T14:15:28.715429+0000","last_peered":"2023-08-09T14:15:28.715429+0000","last_clean":"2023-08-09T14:15:28.715429+0000","last_became_active":"2023-08-09T14:15:27.372090+0000","last_became_peered":"2023-08-09T14:15:27.372090+0000","last_unstale":"2023-08-09T14:15:28.715429+0000","last_undegraded":"2023-08-09T14:15:28.715429+0000","last_fullsized":"2023-08-09T14:15:28.715429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365588+0000","last_change":"2023-08-09T14:15:27.362581+0000","last_active":"2023-08-09T14:15:28.365588+0000","last_peered":"2023-08-09T14:15:28.365588+0000","last_clean":"2023-08-09T14:15:28.365588+0000","last_became_active":"2023-08-09T14:15:27.362258+0000","last_became_peered":"2023-08-09T14:15:27.362258+0000","last_unstale":"2023-08-09T14:15:28.365588+0000","last_undegraded":"2023-08-09T14:15:28.365588+0000","last_fullsized":"2023-08-09T14:15:28.365588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:41:12.126098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.374336+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.374042+0000","last_became_peered":"2023-08-09T14:15:27.374042+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:59.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365710+0000","last_change":"2023-08-09T14:15:27.374636+0000","last_active":"2023-08-09T14:15:28.365710+0000","last_peered":"2023-08-09T14:15:28.365710+0000","last_clean":"2023-08-09T14:15:28.365710+0000","last_became_active":"2023-08-09T14:15:27.374373+0000","last_became_peered":"2023-08-09T14:15:27.374373+0000","last_unstale":"2023-08-09T14:15:28.365710+0000","last_undegraded":"2023-08-09T14:15:28.365710+0000","last_fullsized":"2023-08-09T14:15:28.365710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:47:45.522434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365339+0000","last_change":"2023-08-09T14:15:27.371398+0000","last_active":"2023-08-09T14:15:28.365339+0000","last_peered":"2023-08-09T14:15:28.365339+0000","last_clean":"2023-08-09T14:15:28.365339+0000","last_became_active":"2023-08-09T14:15:27.371094+0000","last_became_peered":"2023-08-09T14:15:27.371094+0000","last_unstale":"2023-08-09T14:15:28.365339+0000","last_undegraded":"2023-08-09T14:15:28.365339+0000","last_fullsized":"2023-08-09T14:15:28.365339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714891+0000","last_change":"2023-08-09T14:15:27.373020+0000","last_active":"2023-08-09T14:15:28.714891+0000","last_peered":"2023-08-09T14:15:28.714891+0000","last_clean":"2023-08-09T14:15:28.714891+0000","last_became_active":"2023-08-09T14:15:27.371864+0000","last_became_peered":"2023-08-09T14:15:27.371864+0000","last_unstale":"2023-08-09T14:15:28.714891+0000","last_undegraded":"2023-08-09T14:15:28.714891+0000","last_fullsized":"2023-08-09T14:15:28.714891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715197+0000","last_change":"2023-08-09T14:15:27.360056+0000","last_active":"2023-08-09T14:15:28.715197+0000","last_peered":"2023-08-09T14:15:28.715197+0000","last_clean":"2023-08-09T14:15:28.715197+0000","last_became_active":"2023-08-09T14:15:27.359789+0000","last_became_peered":"2023-08-09T14:15:27.359789+0000","last_unstale":"2023-08-09T14:15:28.715197+0000","last_undegraded":"2023-08-09T14:15:28.715197+0000","last_fullsized":"2023-08-09T14:15:28.715197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364182+0000","last_change":"2023-08-09T14:15:27.370713+0000","last_active":"2023-08-09T14:15:28.364182+0000","last_peered":"2023-08-09T14:15:28.364182+0000","last_clean":"2023-08-09T14:15:28.364182+0000","last_became_active":"2023-08-09T14:15:27.370350+0000","last_became_peered":"2023-08-09T14:15:27.370350+0000","last_unstale":"2023-08-09T14:15:28.364182+0000","last_undegraded":"2023-08-09T14:15:28.364182+0000","last_fullsized":"2023-08-09T14:15:28.364182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.376534+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.376246+0000","last_became_peered":"2023-08-09T14:15:27.376246+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363636+0000","last_change":"2023-08-09T14:15:27.371361+0000","last_active":"2023-08-09T14:15:28.363636+0000","last_peered":"2023-08-09T14:15:28.363636+0000","last_clean":"2023-08-09T14:15:28.363636+0000","last_became_active":"2023-08-09T14:15:27.371080+0000","last_became_peered":"2023-08-09T14:15:27.371080+0000","last_unstale":"2023-08-09T14:15:28.363636+0000","last_undegraded":"2023-08-09T14:15:28.363636+0000","last_fullsized":"2023-08-09T14:15:28.363636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715083+0000","last_change":"2023-08-09T14:15:27.368916+0000","last_active":"2023-08-09T14:15:28.715083+0000","last_peered":"2023-08-09T14:15:28.715083+0000","last_clean":"2023-08-09T14:15:28.715083+0000","last_became_active":"2023-08-09T14:15:27.367870+0000","last_became_peered":"2023-08-09T14:15:27.367870+0000","last_unstale":"2023-08-09T14:15:28.715083+0000","last_undegraded":"2023-08-09T14:15:28.715083+0000","last_fullsized":"2023-08-09T14:15:28.715083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364479+0000","last_change":"2023-08-09T14:15:26.362153+0000","last_active":"2023-08-09T14:15:28.364479+0000","last_peered":"2023-08-09T14:15:28.364479+0000","last_clean":"2023-08-09T14:15:28.364479+0000","last_became_active":"2023-08-09T14:15:26.361870+0000","last_became_peered":"2023-08-09T14:15:26.361870+0000","last_unstale":"2023-08-09T14:15:28.364479+0000","last_undegraded":"2023-08-09T14:15:28.364479+0000","last_fullsized":"2023-08-09T14:15:28.364479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715977+0000","last_change":"2023-08-09T14:15:27.365726+0000","last_active":"2023-08-09T14:15:28.715977+0000","last_peered":"2023-08-09T14:15:28.715977+0000","last_clean":"2023-08-09T14:15:28.715977+0000","last_became_active":"2023-08-09T14:15:27.365446+0000","last_became_peered":"2023-08-09T14:15:27.365446+0000","last_unstale":"2023-08-09T14:15:28.715977+0000","last_undegraded":"2023-08-09T14:15:28.715977+0000","last_fullsized":"2023-08-09T14:15:28.715977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363356+0000","last_change":"2023-08-09T14:15:26.366707+0000","last_active":"2023-08-09T14:15:28.363356+0000","last_peered":"2023-08-09T14:15:28.363356+0000","last_clean":"2023-08-09T14:15:28.363356+0000","last_became_active":"2023-08-09T14:15:26.366353+0000","last_became_peered":"2023-08-09T14:15:26.366353+0000","last_unstale":"2023-08-09T14:15:28.363356+0000","last_undegraded":"2023-08-09T14:15:28.363356+0000","last_fullsized":"2023-08-09T14:15:28.363356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:29.574516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715297+0000","last_change":"2023-08-09T14:15:27.368533+0000","last_active":"2023-08-09T14:15:28.715297+0000","last_peered":"2023-08-09T14:15:28.715297+0000","last_clean":"2023-08-09T14:15:28.715297+0000","last_became_active":"2023-08-09T14:15:27.368106+0000","last_became_peered":"2023-08-09T14:15:27.368106+0000","last_unstale":"2023-08-09T14:15:28.715297+0000","last_undegraded":"2023-08-09T14:15:28.715297+0000","last_fullsized":"2023-08-09T14:15:28.715297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715671+0000","last_change":"2023-08-09T14:15:26.363963+0000","last_active":"2023-08-09T14:15:28.715671+0000","last_peered":"2023-08-09T14:15:28.715671+0000","last_clean":"2023-08-09T14:15:28.715671+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715671+0000","last_undegraded":"2023-08-09T14:15:28.715671+0000","last_fullsized":"2023-08-09T14:15:28.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715478+0000","last_change":"2023-08-09T14:15:27.373373+0000","last_active":"2023-08-09T14:15:28.715478+0000","last_peered":"2023-08-09T14:15:28.715478+0000","last_clean":"2023-08-09T14:15:28.715478+0000","last_became_active":"2023-08-09T14:15:27.373052+0000","last_became_peered":"2023-08-09T14:15:27.373052+0000","last_unstale":"2023-08-09T14:15:28.715478+0000","last_undegraded":"2023-08-09T14:15:28.715478+0000","last_fullsized":"2023-08-09T14:15:28.715478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715542+0000","last_change":"2023-08-09T14:15:26.364578+0000","last_active":"2023-08-09T14:15:28.715542+0000","last_peered":"2023-08-09T14:15:28.715542+0000","last_clean":"2023-08-09T14:15:28.715542+0000","last_became_active":"2023-08-09T14:15:26.364070+0000","last_became_peered":"2023-08-09T14:15:26.364070+0000","last_unstale":"2023-08-09T14:15:28.715542+0000","last_undegraded":"2023-08-09T14:15:28.715542+0000","last_fullsized":"2023-08-09T14:15:28.715542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715566+0000","last_change":"2023-08-09T14:15:27.364655+0000","last_active":"2023-08-09T14:15:28.715566+0000","last_peered":"2023-08-09T14:15:28.715566+0000","last_clean":"2023-08-09T14:15:28.715566+0000","last_became_active":"2023-08-09T14:15:27.364316+0000","last_became_peered":"2023-08-09T14:15:27.364316+0000","last_unstale":"2023-08-09T14:15:28.715566+0000","last_undegraded":"2023-08-09T14:15:28.715566+0000","last_fullsized":"2023-08-09T14:15:28.715566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:02.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715462+0000","last_change":"2023-08-09T14:15:26.355952+0000","last_active":"2023-08-09T14:15:28.715462+0000","last_peered":"2023-08-09T14:15:28.715462+0000","last_clean":"2023-08-09T14:15:28.715462+0000","last_became_active":"2023-08-09T14:15:26.355504+0000","last_became_peered":"2023-08-09T14:15:26.355504+0000","last_unstale":"2023-08-09T14:15:28.715462+0000","last_undegraded":"2023-08-09T14:15:28.715462+0000","last_fullsized":"2023-08-09T14:15:28.715462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:16.905292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715749+0000","last_change":"2023-08-09T14:15:27.366627+0000","last_active":"2023-08-09T14:15:28.715749+0000","last_peered":"2023-08-09T14:15:28.715749+0000","last_clean":"2023-08-09T14:15:28.715749+0000","last_became_active":"2023-08-09T14:15:27.366355+0000","last_became_peered":"2023-08-09T14:15:27.366355+0000","last_unstale":"2023-08-09T14:15:28.715749+0000","last_undegraded":"2023-08-09T14:15:28.715749+0000","last_fullsized":"2023-08-09T14:15:28.715749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:31.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365449+0000","last_change":"2023-08-09T14:15:26.369077+0000","last_active":"2023-08-09T14:15:28.365449+0000","last_peered":"2023-08-09T14:15:28.365449+0000","last_clean":"2023-08-09T14:15:28.365449+0000","last_became_active":"2023-08-09T14:15:26.368729+0000","last_became_peered":"2023-08-09T14:15:26.368729+0000","last_unstale":"2023-08-09T14:15:28.365449+0000","last_undegraded":"2023-08-09T14:15:28.365449+0000","last_fullsized":"2023-08-09T14:15:28.365449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:31.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363694+0000","last_change":"2023-08-09T14:15:27.376850+0000","last_active":"2023-08-09T14:15:28.363694+0000","last_peered":"2023-08-09T14:15:28.363694+0000","last_clean":"2023-08-09T14:15:28.363694+0000","last_became_active":"2023-08-09T14:15:27.376373+0000","last_became_peered":"2023-08-09T14:15:27.376373+0000","last_unstale":"2023-08-09T14:15:28.363694+0000","last_undegraded":"2023-08-09T14:15:28.363694+0000","last_fullsized":"2023-08-09T14:15:28.363694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365232+0000","last_change":"2023-08-09T14:15:26.356121+0000","last_active":"2023-08-09T14:15:28.365232+0000","last_peered":"2023-08-09T14:15:28.365232+0000","last_clean":"2023-08-09T14:15:28.365232+0000","last_became_active":"2023-08-09T14:15:26.355766+0000","last_became_peered":"2023-08-09T14:15:26.355766+0000","last_unstale":"2023-08-09T14:15:28.365232+0000","last_undegraded":"2023-08-09T14:15:28.365232+0000","last_fullsized":"2023-08-09T14:15:28.365232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:05.063045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365844+0000","last_change":"2023-08-09T14:15:27.373146+0000","last_active":"2023-08-09T14:15:28.365844+0000","last_peered":"2023-08-09T14:15:28.365844+0000","last_clean":"2023-08-09T14:15:28.365844+0000","last_became_active":"2023-08-09T14:15:27.372860+0000","last_became_peered":"2023-08-09T14:15:27.372860+0000","last_unstale":"2023-08-09T14:15:28.365844+0000","last_undegraded":"2023-08-09T14:15:28.365844+0000","last_fullsized":"2023-08-09T14:15:28.365844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:19:06.218840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365182+0000","last_change":"2023-08-09T14:15:26.359070+0000","last_active":"2023-08-09T14:15:28.365182+0000","last_peered":"2023-08-09T14:15:28.365182+0000","last_clean":"2023-08-09T14:15:28.365182+0000","last_became_active":"2023-08-09T14:15:26.357308+0000","last_became_peered":"2023-08-09T14:15:26.357308+0000","last_unstale":"2023-08-09T14:15:28.365182+0000","last_undegraded":"2023-08-09T14:15:28.365182+0000","last_fullsized":"2023-08-09T14:15:28.365182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715653+0000","last_change":"2023-08-09T14:15:27.373211+0000","last_active":"2023-08-09T14:15:28.715653+0000","last_peered":"2023-08-09T14:15:28.715653+0000","last_clean":"2023-08-09T14:15:28.715653+0000","last_became_active":"2023-08-09T14:15:27.372904+0000","last_became_peered":"2023-08-09T14:15:27.372904+0000","last_unstale":"2023-08-09T14:15:28.715653+0000","last_undegraded":"2023-08-09T14:15:28.715653+0000","last_fullsized":"2023-08-09T14:15:28.715653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714978+0000","last_change":"2023-08-09T14:15:26.365445+0000","last_active":"2023-08-09T14:15:28.714978+0000","last_peered":"2023-08-09T14:15:28.714978+0000","last_clean":"2023-08-09T14:15:28.714978+0000","last_became_active":"2023-08-09T14:15:26.365146+0000","last_became_peered":"2023-08-09T14:15:26.365146+0000","last_unstale":"2023-08-09T14:15:28.714978+0000","last_undegraded":"2023-08-09T14:15:28.714978+0000","last_fullsized":"2023-08-09T14:15:28.714978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715163+0000","last_change":"2023-08-09T14:15:27.368128+0000","last_active":"2023-08-09T14:15:28.715163+0000","last_peered":"2023-08-09T14:15:28.715163+0000","last_clean":"2023-08-09T14:15:28.715163+0000","last_became_active":"2023-08-09T14:15:27.365878+0000","last_became_peered":"2023-08-09T14:15:27.365878+0000","last_unstale":"2023-08-09T14:15:28.715163+0000","last_undegraded":"2023-08-09T14:15:28.715163+0000","last_fullsized":"2023-08-09T14:15:28.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365331+0000","last_change":"2023-08-09T14:15:26.362477+0000","last_active":"2023-08-09T14:15:28.365331+0000","last_peered":"2023-08-09T14:15:28.365331+0000","last_clean":"2023-08-09T14:15:28.365331+0000","last_became_active":"2023-08-09T14:15:26.362201+0000","last_became_peered":"2023-08-09T14:15:26.362201+0000","last_unstale":"2023-08-09T14:15:28.365331+0000","last_undegraded":"2023-08-09T14:15:28.365331+0000","last_fullsized":"2023-08-09T14:15:28.365331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715086+0000","last_change":"2023-08-09T14:15:27.368351+0000","last_active":"2023-08-09T14:15:28.715086+0000","last_peered":"2023-08-09T14:15:28.715086+0000","last_clean":"2023-08-09T14:15:28.715086+0000","last_became_active":"2023-08-09T14:15:27.367354+0000","last_became_peered":"2023-08-09T14:15:27.367354+0000","last_unstale":"2023-08-09T14:15:28.715086+0000","last_undegraded":"2023-08-09T14:15:28.715086+0000","last_fullsized":"2023-08-09T14:15:28.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714566+0000","last_change":"2023-08-09T14:15:26.364067+0000","last_active":"2023-08-09T14:15:28.714566+0000","last_peered":"2023-08-09T14:15:28.714566+0000","last_clean":"2023-08-09T14:15:28.714566+0000","last_became_active":"2023-08-09T14:15:26.363763+0000","last_became_peered":"2023-08-09T14:15:26.363763+0000","last_unstale":"2023-08-09T14:15:28.714566+0000","last_undegraded":"2023-08-09T14:15:28.714566+0000","last_fullsized":"2023-08-09T14:15:28.714566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:13.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716271+0000","last_change":"2023-08-09T14:15:27.367007+0000","last_active":"2023-08-09T14:15:28.716271+0000","last_peered":"2023-08-09T14:15:28.716271+0000","last_clean":"2023-08-09T14:15:28.716271+0000","last_became_active":"2023-08-09T14:15:27.366701+0000","last_became_peered":"2023-08-09T14:15:27.366701+0000","last_unstale":"2023-08-09T14:15:28.716271+0000","last_undegraded":"2023-08-09T14:15:28.716271+0000","last_fullsized":"2023-08-09T14:15:28.716271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364911+0000","last_change":"2023-08-09T14:15:26.358111+0000","last_active":"2023-08-09T14:15:28.364911+0000","last_peered":"2023-08-09T14:15:28.364911+0000","last_clean":"2023-08-09T14:15:28.364911+0000","last_became_active":"2023-08-09T14:15:26.357775+0000","last_became_peered":"2023-08-09T14:15:26.357775+0000","last_unstale":"2023-08-09T14:15:28.364911+0000","last_undegraded":"2023-08-09T14:15:28.364911+0000","last_fullsized":"2023-08-09T14:15:28.364911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:02.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715182+0000","last_change":"2023-08-09T14:15:27.370898+0000","last_active":"2023-08-09T14:15:28.715182+0000","last_peered":"2023-08-09T14:15:28.715182+0000","last_clean":"2023-08-09T14:15:28.715182+0000","last_became_active":"2023-08-09T14:15:27.370605+0000","last_became_peered":"2023-08-09T14:15:27.370605+0000","last_unstale":"2023-08-09T14:15:28.715182+0000","last_undegraded":"2023-08-09T14:15:28.715182+0000","last_fullsized":"2023-08-09T14:15:28.715182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364888+0000","last_change":"2023-08-09T14:15:26.356264+0000","last_active":"2023-08-09T14:15:28.364888+0000","last_peered":"2023-08-09T14:15:28.364888+0000","last_clean":"2023-08-09T14:15:28.364888+0000","last_became_active":"2023-08-09T14:15:26.355974+0000","last_became_peered":"2023-08-09T14:15:26.355974+0000","last_unstale":"2023-08-09T14:15:28.364888+0000","last_undegraded":"2023-08-09T14:15:28.364888+0000","last_fullsized":"2023-08-09T14:15:28.364888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364131+0000","last_change":"2023-08-09T14:15:27.364910+0000","last_active":"2023-08-09T14:15:28.364131+0000","last_peered":"2023-08-09T14:15:28.364131+0000","last_clean":"2023-08-09T14:15:28.364131+0000","last_became_active":"2023-08-09T14:15:27.364633+0000","last_became_peered":"2023-08-09T14:15:27.364633+0000","last_unstale":"2023-08-09T14:15:28.364131+0000","last_undegraded":"2023-08-09T14:15:28.364131+0000","last_fullsized":"2023-08-09T14:15:28.364131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365252+0000","last_change":"2023-08-09T14:15:26.359582+0000","last_active":"2023-08-09T14:15:28.365252+0000","last_peered":"2023-08-09T14:15:28.365252+0000","last_clean":"2023-08-09T14:15:28.365252+0000","last_became_active":"2023-08-09T14:15:26.358709+0000","last_became_peered":"2023-08-09T14:15:26.358709+0000","last_unstale":"2023-08-09T14:15:28.365252+0000","last_undegraded":"2023-08-09T14:15:28.365252+0000","last_fullsized":"2023-08-09T14:15:28.365252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:37.757503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715501+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715501+0000","last_peered":"2023-08-09T14:15:28.715501+0000","last_clean":"2023-08-09T14:15:28.715501+0000","last_became_active":"2023-08-09T14:15:27.376934+0000","last_became_peered":"2023-08-09T14:15:27.376934+0000","last_unstale":"2023-08-09T14:15:28.715501+0000","last_undegraded":"2023-08-09T14:15:28.715501+0000","last_fullsized":"2023-08-09T14:15:28.715501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715282+0000","last_change":"2023-08-09T14:15:26.361599+0000","last_active":"2023-08-09T14:15:28.715282+0000","last_peered":"2023-08-09T14:15:28.715282+0000","last_clean":"2023-08-09T14:15:28.715282+0000","last_became_active":"2023-08-09T14:15:26.361344+0000","last_became_peered":"2023-08-09T14:15:26.361344+0000","last_unstale":"2023-08-09T14:15:28.715282+0000","last_undegraded":"2023-08-09T14:15:28.715282+0000","last_fullsized":"2023-08-09T14:15:28.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:54.887960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714818+0000","last_change":"2023-08-09T14:15:27.377369+0000","last_active":"2023-08-09T14:15:28.714818+0000","last_peered":"2023-08-09T14:15:28.714818+0000","last_clean":"2023-08-09T14:15:28.714818+0000","last_became_active":"2023-08-09T14:15:27.376969+0000","last_became_peered":"2023-08-09T14:15:27.376969+0000","last_unstale":"2023-08-09T14:15:28.714818+0000","last_undegraded":"2023-08-09T14:15:28.714818+0000","last_fullsized":"2023-08-09T14:15:28.714818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715897+0000","last_change":"2023-08-09T14:15:26.365316+0000","last_active":"2023-08-09T14:15:28.715897+0000","last_peered":"2023-08-09T14:15:28.715897+0000","last_clean":"2023-08-09T14:15:28.715897+0000","last_became_active":"2023-08-09T14:15:26.365027+0000","last_became_peered":"2023-08-09T14:15:26.365027+0000","last_unstale":"2023-08-09T14:15:28.715897+0000","last_undegraded":"2023-08-09T14:15:28.715897+0000","last_fullsized":"2023-08-09T14:15:28.715897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365111+0000","last_change":"2023-08-09T14:15:27.364606+0000","last_active":"2023-08-09T14:15:28.365111+0000","last_peered":"2023-08-09T14:15:28.365111+0000","last_clean":"2023-08-09T14:15:28.365111+0000","last_became_active":"2023-08-09T14:15:27.364110+0000","last_became_peered":"2023-08-09T14:15:27.364110+0000","last_unstale":"2023-08-09T14:15:28.365111+0000","last_undegraded":"2023-08-09T14:15:28.365111+0000","last_fullsized":"2023-08-09T14:15:28.365111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715355+0000","last_change":"2023-08-09T14:15:26.364188+0000","last_active":"2023-08-09T14:15:28.715355+0000","last_peered":"2023-08-09T14:15:28.715355+0000","last_clean":"2023-08-09T14:15:28.715355+0000","last_became_active":"2023-08-09T14:15:26.363813+0000","last_became_peered":"2023-08-09T14:15:26.363813+0000","last_unstale":"2023-08-09T14:15:28.715355+0000","last_undegraded":"2023-08-09T14:15:28.715355+0000","last_fullsized":"2023-08-09T14:15:28.715355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:54.109205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365408+0000","last_change":"2023-08-09T14:15:27.361904+0000","last_active":"2023-08-09T14:15:28.365408+0000","last_peered":"2023-08-09T14:15:28.365408+0000","last_clean":"2023-08-09T14:15:28.365408+0000","last_became_active":"2023-08-09T14:15:27.361611+0000","last_became_peered":"2023-08-09T14:15:27.361611+0000","last_unstale":"2023-08-09T14:15:28.365408+0000","last_undegraded":"2023-08-09T14:15:28.365408+0000","last_fullsized":"2023-08-09T14:15:28.365408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:32.068473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364274+0000","last_change":"2023-08-09T14:15:26.369258+0000","last_active":"2023-08-09T14:15:28.364274+0000","last_peered":"2023-08-09T14:15:28.364274+0000","last_clean":"2023-08-09T14:15:28.364274+0000","last_became_active":"2023-08-09T14:15:26.368961+0000","last_became_peered":"2023-08-09T14:15:26.368961+0000","last_unstale":"2023-08-09T14:15:28.364274+0000","last_undegraded":"2023-08-09T14:15:28.364274+0000","last_fullsized":"2023-08-09T14:15:28.364274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365673+0000","last_change":"2023-08-09T14:15:27.372992+0000","last_active":"2023-08-09T14:15:28.365673+0000","last_peered":"2023-08-09T14:15:28.365673+0000","last_clean":"2023-08-09T14:15:28.365673+0000","last_became_active":"2023-08-09T14:15:27.372751+0000","last_became_peered":"2023-08-09T14:15:27.372751+0000","last_unstale":"2023-08-09T14:15:28.365673+0000","last_undegraded":"2023-08-09T14:15:28.365673+0000","last_fullsized":"2023-08-09T14:15:28.365673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:31.574664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715405+0000","last_change":"2023-08-09T14:15:26.363414+0000","last_active":"2023-08-09T14:15:28.715405+0000","last_peered":"2023-08-09T14:15:28.715405+0000","last_clean":"2023-08-09T14:15:28.715405+0000","last_became_active":"2023-08-09T14:15:26.363094+0000","last_became_peered":"2023-08-09T14:15:26.363094+0000","last_unstale":"2023-08-09T14:15:28.715405+0000","last_undegraded":"2023-08-09T14:15:28.715405+0000","last_fullsized":"2023-08-09T14:15:28.715405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:32.261834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363815+0000","last_change":"2023-08-09T14:15:27.358343+0000","last_active":"2023-08-09T14:15:28.363815+0000","last_peered":"2023-08-09T14:15:28.363815+0000","last_clean":"2023-08-09T14:15:28.363815+0000","last_became_active":"2023-08-09T14:15:27.358044+0000","last_became_peered":"2023-08-09T14:15:27.358044+0000","last_unstale":"2023-08-09T14:15:28.363815+0000","last_undegraded":"2023-08-09T14:15:28.363815+0000","last_fullsized":"2023-08-09T14:15:28.363815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716164+0000","last_change":"2023-08-09T14:15:26.358191+0000","last_active":"2023-08-09T14:15:28.716164+0000","last_peered":"2023-08-09T14:15:28.716164+0000","last_clean":"2023-08-09T14:15:28.716164+0000","last_became_active":"2023-08-09T14:15:26.357725+0000","last_became_peered":"2023-08-09T14:15:26.357725+0000","last_unstale":"2023-08-09T14:15:28.716164+0000","last_undegraded":"2023-08-09T14:15:28.716164+0000","last_fullsized":"2023-08-09T14:15:28.716164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365165+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:15:28.365165+0000","last_peered":"2023-08-09T14:15:28.365165+0000","last_clean":"2023-08-09T14:15:28.365165+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:15:28.365165+0000","last_undegraded":"2023-08-09T14:15:28.365165+0000","last_fullsized":"2023-08-09T14:15:28.365165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:29.070235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715537+0000","last_change":"2023-08-09T14:15:27.370345+0000","last_active":"2023-08-09T14:15:28.715537+0000","last_peered":"2023-08-09T14:15:28.715537+0000","last_clean":"2023-08-09T14:15:28.715537+0000","last_became_active":"2023-08-09T14:15:27.370097+0000","last_became_peered":"2023-08-09T14:15:27.370097+0000","last_unstale":"2023-08-09T14:15:28.715537+0000","last_undegraded":"2023-08-09T14:15:28.715537+0000","last_fullsized":"2023-08-09T14:15:28.715537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715740+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:15:28.715740+0000","last_peered":"2023-08-09T14:15:28.715740+0000","last_clean":"2023-08-09T14:15:28.715740+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:15:28.715740+0000","last_undegraded":"2023-08-09T14:15:28.715740+0000","last_fullsized":"2023-08-09T14:15:28.715740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:49.358632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715336+0000","last_change":"2023-08-09T14:15:26.362381+0000","last_active":"2023-08-09T14:15:28.715336+0000","last_peered":"2023-08-09T14:15:28.715336+0000","last_clean":"2023-08-09T14:15:28.715336+0000","last_became_active":"2023-08-09T14:15:26.362034+0000","last_became_peered":"2023-08-09T14:15:26.362034+0000","last_unstale":"2023-08-09T14:15:28.715336+0000","last_undegraded":"2023-08-09T14:15:28.715336+0000","last_fullsized":"2023-08-09T14:15:28.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365369+0000","last_change":"2023-08-09T14:15:27.364324+0000","last_active":"2023-08-09T14:15:28.365369+0000","last_peered":"2023-08-09T14:15:28.365369+0000","last_clean":"2023-08-09T14:15:28.365369+0000","last_became_active":"2023-08-09T14:15:27.364037+0000","last_became_peered":"2023-08-09T14:15:27.364037+0000","last_unstale":"2023-08-09T14:15:28.365369+0000","last_undegraded":"2023-08-09T14:15:28.365369+0000","last_fullsized":"2023-08-09T14:15:28.365369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363416+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:15:28.363416+0000","last_peered":"2023-08-09T14:15:28.363416+0000","last_clean":"2023-08-09T14:15:28.363416+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:15:28.363416+0000","last_undegraded":"2023-08-09T14:15:28.363416+0000","last_fullsized":"2023-08-09T14:15:28.363416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:16.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364505+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:15:28.364505+0000","last_peered":"2023-08-09T14:15:28.364505+0000","last_clean":"2023-08-09T14:15:28.364505+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:15:28.364505+0000","last_undegraded":"2023-08-09T14:15:28.364505+0000","last_fullsized":"2023-08-09T14:15:28.364505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:25.028342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714831+0000","last_change":"2023-08-09T14:15:26.359463+0000","last_active":"2023-08-09T14:15:28.714831+0000","last_peered":"2023-08-09T14:15:28.714831+0000","last_clean":"2023-08-09T14:15:28.714831+0000","last_became_active":"2023-08-09T14:15:26.359089+0000","last_became_peered":"2023-08-09T14:15:26.359089+0000","last_unstale":"2023-08-09T14:15:28.714831+0000","last_undegraded":"2023-08-09T14:15:28.714831+0000","last_fullsized":"2023-08-09T14:15:28.714831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:21.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715221+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715221+0000","last_peered":"2023-08-09T14:15:28.715221+0000","last_clean":"2023-08-09T14:15:28.715221+0000","last_became_active":"2023-08-09T14:15:27.377030+0000","last_became_peered":"2023-08-09T14:15:27.377030+0000","last_unstale":"2023-08-09T14:15:28.715221+0000","last_undegraded":"2023-08-09T14:15:28.715221+0000","last_fullsized":"2023-08-09T14:15:28.715221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364475+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:15:28.364475+0000","last_peered":"2023-08-09T14:15:28.364475+0000","last_clean":"2023-08-09T14:15:28.364475+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:15:28.364475+0000","last_undegraded":"2023-08-09T14:15:28.364475+0000","last_fullsized":"2023-08-09T14:15:28.364475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:58.636275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363246+0000","last_change":"2023-08-09T14:15:26.370171+0000","last_active":"2023-08-09T14:15:28.363246+0000","last_peered":"2023-08-09T14:15:28.363246+0000","last_clean":"2023-08-09T14:15:28.363246+0000","last_became_active":"2023-08-09T14:15:26.369702+0000","last_became_peered":"2023-08-09T14:15:26.369702+0000","last_unstale":"2023-08-09T14:15:28.363246+0000","last_undegraded":"2023-08-09T14:15:28.363246+0000","last_fullsized":"2023-08-09T14:15:28.363246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:33.713389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363721+0000","last_change":"2023-08-09T14:15:27.365430+0000","last_active":"2023-08-09T14:15:28.363721+0000","last_peered":"2023-08-09T14:15:28.363721+0000","last_clean":"2023-08-09T14:15:28.363721+0000","last_became_active":"2023-08-09T14:15:27.365151+0000","last_became_peered":"2023-08-09T14:15:27.365151+0000","last_unstale":"2023-08-09T14:15:28.363721+0000","last_undegraded":"2023-08-09T14:15:28.363721+0000","last_fullsized":"2023-08-09T14:15:28.363721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363905+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:15:28.363905+0000","last_peered":"2023-08-09T14:15:28.363905+0000","last_clean":"2023-08-09T14:15:28.363905+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.363905+0000","last_undegraded":"2023-08-09T14:15:28.363905+0000","last_fullsized":"2023-08-09T14:15:28.363905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.854209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715456+0000","last_change":"2023-08-09T14:15:26.358773+0000","last_active":"2023-08-09T14:15:28.715456+0000","last_peered":"2023-08-09T14:15:28.715456+0000","last_clean":"2023-08-09T14:15:28.715456+0000","last_became_active":"2023-08-09T14:15:26.358468+0000","last_became_peered":"2023-08-09T14:15:26.358468+0000","last_unstale":"2023-08-09T14:15:28.715456+0000","last_undegraded":"2023-08-09T14:15:28.715456+0000","last_fullsized":"2023-08-09T14:15:28.715456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:44.991430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714808+0000","last_change":"2023-08-09T14:15:27.375825+0000","last_active":"2023-08-09T14:15:28.714808+0000","last_peered":"2023-08-09T14:15:28.714808+0000","last_clean":"2023-08-09T14:15:28.714808+0000","last_became_active":"2023-08-09T14:15:27.375528+0000","last_became_peered":"2023-08-09T14:15:27.375528+0000","last_unstale":"2023-08-09T14:15:28.714808+0000","last_undegraded":"2023-08-09T14:15:28.714808+0000","last_fullsized":"2023-08-09T14:15:28.714808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:30.580011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714894+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:15:28.714894+0000","last_peered":"2023-08-09T14:15:28.714894+0000","last_clean":"2023-08-09T14:15:28.714894+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.714894+0000","last_undegraded":"2023-08-09T14:15:28.714894+0000","last_fullsized":"2023-08-09T14:15:28.714894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:49.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364555+0000","last_change":"2023-08-09T14:15:26.363945+0000","last_active":"2023-08-09T14:15:28.364555+0000","last_peered":"2023-08-09T14:15:28.364555+0000","last_clean":"2023-08-09T14:15:28.364555+0000","last_became_active":"2023-08-09T14:15:26.363660+0000","last_became_peered":"2023-08-09T14:15:26.363660+0000","last_unstale":"2023-08-09T14:15:28.364555+0000","last_undegraded":"2023-08-09T14:15:28.364555+0000","last_fullsized":"2023-08-09T14:15:28.364555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363792+0000","last_change":"2023-08-09T14:15:27.367876+0000","last_active":"2023-08-09T14:15:28.363792+0000","last_peered":"2023-08-09T14:15:28.363792+0000","last_clean":"2023-08-09T14:15:28.363792+0000","last_became_active":"2023-08-09T14:15:27.367423+0000","last_became_peered":"2023-08-09T14:15:27.367423+0000","last_unstale":"2023-08-09T14:15:28.363792+0000","last_undegraded":"2023-08-09T14:15:28.363792+0000","last_fullsized":"2023-08-09T14:15:28.363792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714849+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:15:28.714849+0000","last_peered":"2023-08-09T14:15:28.714849+0000","last_clean":"2023-08-09T14:15:28.714849+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:15:28.714849+0000","last_undegraded":"2023-08-09T14:15:28.714849+0000","last_fullsized":"2023-08-09T14:15:28.714849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:50.502422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363714+0000","last_change":"2023-08-09T14:15:26.369783+0000","last_active":"2023-08-09T14:15:28.363714+0000","last_peered":"2023-08-09T14:15:28.363714+0000","last_clean":"2023-08-09T14:15:28.363714+0000","last_became_active":"2023-08-09T14:15:26.369470+0000","last_became_peered":"2023-08-09T14:15:26.369470+0000","last_unstale":"2023-08-09T14:15:28.363714+0000","last_undegraded":"2023-08-09T14:15:28.363714+0000","last_fullsized":"2023-08-09T14:15:28.363714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:05.002240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715142+0000","last_change":"2023-08-09T14:15:27.369319+0000","last_active":"2023-08-09T14:15:28.715142+0000","last_peered":"2023-08-09T14:15:28.715142+0000","last_clean":"2023-08-09T14:15:28.715142+0000","last_became_active":"2023-08-09T14:15:27.369020+0000","last_became_peered":"2023-08-09T14:15:27.369020+0000","last_unstale":"2023-08-09T14:15:28.715142+0000","last_undegraded":"2023-08-09T14:15:28.715142+0000","last_fullsized":"2023-08-09T14:15:28.715142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715532+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:15:28.715532+0000","last_peered":"2023-08-09T14:15:28.715532+0000","last_clean":"2023-08-09T14:15:28.715532+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:15:28.715532+0000","last_undegraded":"2023-08-09T14:15:28.715532+0000","last_fullsized":"2023-08-09T14:15:28.715532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:38.576973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715315+0000","last_change":"2023-08-09T14:15:26.362755+0000","last_active":"2023-08-09T14:15:28.715315+0000","last_peered":"2023-08-09T14:15:28.715315+0000","last_clean":"2023-08-09T14:15:28.715315+0000","last_became_active":"2023-08-09T14:15:26.362469+0000","last_became_peered":"2023-08-09T14:15:26.362469+0000","last_unstale":"2023-08-09T14:15:28.715315+0000","last_undegraded":"2023-08-09T14:15:28.715315+0000","last_fullsized":"2023-08-09T14:15:28.715315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363514+0000","last_change":"2023-08-09T14:15:27.364616+0000","last_active":"2023-08-09T14:15:28.363514+0000","last_peered":"2023-08-09T14:15:28.363514+0000","last_clean":"2023-08-09T14:15:28.363514+0000","last_became_active":"2023-08-09T14:15:27.364247+0000","last_became_peered":"2023-08-09T14:15:27.364247+0000","last_unstale":"2023-08-09T14:15:28.363514+0000","last_undegraded":"2023-08-09T14:15:28.363514+0000","last_fullsized":"2023-08-09T14:15:28.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714984+0000","last_change":"2023-08-09T14:15:26.358586+0000","last_active":"2023-08-09T14:15:28.714984+0000","last_peered":"2023-08-09T14:15:28.714984+0000","last_clean":"2023-08-09T14:15:28.714984+0000","last_became_active":"2023-08-09T14:15:26.358267+0000","last_became_peered":"2023-08-09T14:15:26.358267+0000","last_unstale":"2023-08-09T14:15:28.714984+0000","last_undegraded":"2023-08-09T14:15:28.714984+0000","last_fullsized":"2023-08-09T14:15:28.714984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:32.171526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714879+0000","last_change":"2023-08-09T14:15:27.373217+0000","last_active":"2023-08-09T14:15:28.714879+0000","last_peered":"2023-08-09T14:15:28.714879+0000","last_clean":"2023-08-09T14:15:28.714879+0000","last_became_active":"2023-08-09T14:15:27.372954+0000","last_became_peered":"2023-08-09T14:15:27.372954+0000","last_unstale":"2023-08-09T14:15:28.714879+0000","last_undegraded":"2023-08-09T14:15:28.714879+0000","last_fullsized":"2023-08-09T14:15:28.714879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:01.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715067+0000","last_change":"2023-08-09T14:15:26.358758+0000","last_active":"2023-08-09T14:15:28.715067+0000","last_peered":"2023-08-09T14:15:28.715067+0000","last_clean":"2023-08-09T14:15:28.715067+0000","last_became_active":"2023-08-09T14:15:26.358393+0000","last_became_peered":"2023-08-09T14:15:26.358393+0000","last_unstale":"2023-08-09T14:15:28.715067+0000","last_undegraded":"2023-08-09T14:15:28.715067+0000","last_fullsized":"2023-08-09T14:15:28.715067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364413+0000","last_change":"2023-08-09T14:15:27.364626+0000","last_active":"2023-08-09T14:15:28.364413+0000","last_peered":"2023-08-09T14:15:28.364413+0000","last_clean":"2023-08-09T14:15:28.364413+0000","last_became_active":"2023-08-09T14:15:27.364351+0000","last_became_peered":"2023-08-09T14:15:27.364351+0000","last_unstale":"2023-08-09T14:15:28.364413+0000","last_undegraded":"2023-08-09T14:15:28.364413+0000","last_fullsized":"2023-08-09T14:15:28.364413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715277+0000","last_change":"2023-08-09T14:15:26.358163+0000","last_active":"2023-08-09T14:15:28.715277+0000","last_peered":"2023-08-09T14:15:28.715277+0000","last_clean":"2023-08-09T14:15:28.715277+0000","last_became_active":"2023-08-09T14:15:26.357889+0000","last_became_peered":"2023-08-09T14:15:26.357889+0000","last_unstale":"2023-08-09T14:15:28.715277+0000","last_undegraded":"2023-08-09T14:15:28.715277+0000","last_fullsized":"2023-08-09T14:15:28.715277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:09.104325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364686+0000","last_change":"2023-08-09T14:15:27.355036+0000","last_active":"2023-08-09T14:15:28.364686+0000","last_peered":"2023-08-09T14:15:28.364686+0000","last_clean":"2023-08-09T14:15:28.364686+0000","last_became_active":"2023-08-09T14:15:27.354292+0000","last_became_peered":"2023-08-09T14:15:27.354292+0000","last_unstale":"2023-08-09T14:15:28.364686+0000","last_undegraded":"2023-08-09T14:15:28.364686+0000","last_fullsized":"2023-08-09T14:15:28.364686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715832+0000","last_change":"2023-08-09T14:15:26.368865+0000","last_active":"2023-08-09T14:15:28.715832+0000","last_peered":"2023-08-09T14:15:28.715832+0000","last_clean":"2023-08-09T14:15:28.715832+0000","last_became_active":"2023-08-09T14:15:26.368589+0000","last_became_peered":"2023-08-09T14:15:26.368589+0000","last_unstale":"2023-08-09T14:15:28.715832+0000","last_undegraded":"2023-08-09T14:15:28.715832+0000","last_fullsized":"2023-08-09T14:15:28.715832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:03.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715545+0000","last_change":"2023-08-09T14:15:27.358450+0000","last_active":"2023-08-09T14:15:28.715545+0000","last_peered":"2023-08-09T14:15:28.715545+0000","last_clean":"2023-08-09T14:15:28.715545+0000","last_became_active":"2023-08-09T14:15:27.358162+0000","last_became_peered":"2023-08-09T14:15:27.358162+0000","last_unstale":"2023-08-09T14:15:28.715545+0000","last_undegraded":"2023-08-09T14:15:28.715545+0000","last_fullsized":"2023-08-09T14:15:28.715545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715668+0000","last_change":"2023-08-09T14:15:26.364373+0000","last_active":"2023-08-09T14:15:28.715668+0000","last_peered":"2023-08-09T14:15:28.715668+0000","last_clean":"2023-08-09T14:15:28.715668+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715668+0000","last_undegraded":"2023-08-09T14:15:28.715668+0000","last_fullsized":"2023-08-09T14:15:28.715668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364113+0000","last_change":"2023-08-09T14:15:27.375813+0000","last_active":"2023-08-09T14:15:28.364113+0000","last_peered":"2023-08-09T14:15:28.364113+0000","last_clean":"2023-08-09T14:15:28.364113+0000","last_became_active":"2023-08-09T14:15:27.375552+0000","last_became_peered":"2023-08-09T14:15:27.375552+0000","last_unstale":"2023-08-09T14:15:28.364113+0000","last_undegraded":"2023-08-09T14:15:28.364113+0000","last_fullsized":"2023-08-09T14:15:28.364113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.367331+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.367033+0000","last_became_peered":"2023-08-09T14:15:27.367033+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:34.718883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715351+0000","last_change":"2023-08-09T14:15:27.369804+0000","last_active":"2023-08-09T14:15:28.715351+0000","last_peered":"2023-08-09T14:15:28.715351+0000","last_clean":"2023-08-09T14:15:28.715351+0000","last_became_active":"2023-08-09T14:15:27.369506+0000","last_became_peered":"2023-08-09T14:15:27.369506+0000","last_unstale":"2023-08-09T14:15:28.715351+0000","last_undegraded":"2023-08-09T14:15:28.715351+0000","last_fullsized":"2023-08-09T14:15:28.715351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364336+0000","last_change":"2023-08-09T14:15:27.374295+0000","last_active":"2023-08-09T14:15:28.364336+0000","last_peered":"2023-08-09T14:15:28.364336+0000","last_clean":"2023-08-09T14:15:28.364336+0000","last_became_active":"2023-08-09T14:15:27.373789+0000","last_became_peered":"2023-08-09T14:15:27.373789+0000","last_unstale":"2023-08-09T14:15:28.364336+0000","last_undegraded":"2023-08-09T14:15:28.364336+0000","last_fullsized":"2023-08-09T14:15:28.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715801+0000","last_change":"2023-08-09T14:15:27.371728+0000","last_active":"2023-08-09T14:15:28.715801+0000","last_peered":"2023-08-09T14:15:28.715801+0000","last_clean":"2023-08-09T14:15:28.715801+0000","last_became_active":"2023-08-09T14:15:27.371196+0000","last_became_peered":"2023-08-09T14:15:27.371196+0000","last_unstale":"2023-08-09T14:15:28.715801+0000","last_undegraded":"2023-08-09T14:15:28.715801+0000","last_fullsized":"2023-08-09T14:15:28.715801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.367662+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.366977+0000","last_became_peered":"2023-08-09T14:15:27.366977+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":78259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":77800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":668627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.825}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.778}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3889999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":77238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:15:31.908 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T14:15:31.909 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-09T14:15:31.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-09T14:15:31.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-09T14:15:31.910 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-09T14:15:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.062+0000 7faecbe16700 1 Processor -- start 2023-08-09T14:15:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 -- start start 2023-08-09T14:15:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7faec415d400 0x7faec40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faec406cd50 0x7faec406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec406ab80 con 0x7faec406cd50 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec406e850 con 0x7faec415d400 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faecbe16700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec40cf7b0 con 0x7faec406a1c0 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faeca3b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faec406cd50 0x7faec406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faeca3b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faec406cd50 0x7faec406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42586/0 (socket says 172.21.15.5:42586) 2023-08-09T14:15:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.063+0000 7faeca3b3700 1 -- 172.21.15.5:0/83890162 learned_addr learned my addr 172.21.15.5:0/83890162 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faec9bb2700 1 --2- 172.21.15.5:0/83890162 >> v2:172.21.15.101:3300/0 conn(0x7faec415d400 0x7faec40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faec93b1700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 -- 172.21.15.5:0/83890162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 msgr2=0x7faec406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 -- 172.21.15.5:0/83890162 >> v2:172.21.15.101:3300/0 conn(0x7faec415d400 msgr2=0x7faec40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 --2- 172.21.15.5:0/83890162 >> v2:172.21.15.101:3300/0 conn(0x7faec415d400 0x7faec40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 -- 172.21.15.5:0/83890162 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40cfa90 con 0x7faec406cd50 2023-08-09T14:15:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faeca3b3700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec406cd50 0x7faec406d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faebc009e50 tx=0x7faebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89c5c8de092359a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faec8bb0700 1 -- 172.21.15.5:0/83890162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00e070 con 0x7faec406cd50 2023-08-09T14:15:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faec8bb0700 1 -- 172.21.15.5:0/83890162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00b980 con 0x7faec406cd50 2023-08-09T14:15:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.064+0000 7faec8bb0700 1 -- 172.21.15.5:0/83890162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00bd30 con 0x7faec406cd50 2023-08-09T14:15:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 -- 172.21.15.5:0/83890162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec406cd50 msgr2=0x7faec406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec406cd50 0x7faec406d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faebc009e50 tx=0x7faebc00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 -- 172.21.15.5:0/83890162 shutdown_connections 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 --2- 172.21.15.5:0/83890162 >> v2:172.21.15.101:3300/0 conn(0x7faec415d400 0x7faec40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec406cd50 0x7faec406d1e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 --2- 172.21.15.5:0/83890162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 -- 172.21.15.5:0/83890162 >> 172.21.15.5:0/83890162 conn(0x7faec40b1900 msgr2=0x7faec40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 -- 172.21.15.5:0/83890162 shutdown_connections 2023-08-09T14:15:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.065+0000 7faecbe16700 1 -- 172.21.15.5:0/83890162 wait complete. 2023-08-09T14:15:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.066+0000 7faecbe16700 1 Processor -- start 2023-08-09T14:15:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.066+0000 7faecbe16700 1 -- start start 2023-08-09T14:15:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec4153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 0x7faec40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec4159460 con 0x7faec415d400 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec41f2bd0 con 0x7faec406cd50 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4158850 con 0x7faec406a1c0 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42592/0 (socket says 172.21.15.5:42592) 2023-08-09T14:15:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 -- 172.21.15.5:0/662561032 learned_addr learned my addr 172.21.15.5:0/662561032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faec9bb2700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec4153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faec93b1700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 0x7faec40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 -- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 msgr2=0x7faec4153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec4153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 -- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 msgr2=0x7faec40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 0x7faec40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 -- 172.21.15.5:0/662561032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc009b30 con 0x7faec415d400 2023-08-09T14:15:32.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faec93b1700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 0x7faec40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faec9bb2700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec4153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeca3b3700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faec40b2870 tx=0x7faebc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc004250 con 0x7faec415d400 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc0043b0 con 0x7faec415d400 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec4158b30 con 0x7faec415d400 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc004740 con 0x7faec415d400 2023-08-09T14:15:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.067+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec41590f0 con 0x7faec415d400 2023-08-09T14:15:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.068+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec40b1720 con 0x7faec415d400 2023-08-09T14:15:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.069+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faebc01c440 con 0x7faec415d400 2023-08-09T14:15:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.069+0000 7faeba7fc700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 0x7faea806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.069+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faebc089fe0 con 0x7faec415d400 2023-08-09T14:15:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.069+0000 7faec9bb2700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 0x7faea806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.070+0000 7faec9bb2700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 0x7faea806c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faeb4007a50 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.073+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7faebc055880 con 0x7faec415d400 2023-08-09T14:15:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.330+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faec40c70b0 con 0x7faec415d400 2023-08-09T14:15:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.334+0000 7faeba7fc700 1 -- 172.21.15.5:0/662561032 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169495 (secure 0 0 0) 0x7faebc058ea0 con 0x7faec415d400 2023-08-09T14:15:32.338 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 msgr2=0x7faea806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 0x7faea806c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faeb4007a50 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2023-08-09T14:15:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 msgr2=0x7faec40cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faec40b2870 tx=0x7faebc004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 shutdown_connections 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faea806a0e0 0x7faea806c5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec415d400 0x7faec40cde00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faec406a1c0 0x7faec4153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 --2- 172.21.15.5:0/662561032 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faec406cd50 0x7faec40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 >> 172.21.15.5:0/662561032 conn(0x7faec40b1900 msgr2=0x7faec40d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 shutdown_connections 2023-08-09T14:15:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.336+0000 7faecbe16700 1 -- 172.21.15.5:0/662561032 wait complete. 2023-08-09T14:15:32.351 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6832","nonce":892658077},{"type":"v1","addr":"172.21.15.101:6833","nonce":892658077}]},"active_addr":"172.21.15.101:6833/892658077","active_change":"2023-08-09T14:15:13.771571+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.101:0","nonce":2636314199}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.101:0","nonce":1884592433}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.101:0","nonce":540817458}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.101:0","nonce":2273506617}]}]} 2023-08-09T14:15:32.355 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-09T14:15:32.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-09T14:15:32.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:32.476 INFO:tasks.ceph.mds.b.smithi101.stderr:2023-08-09T14:15:32.475+0000 7fa87fde0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T14:15:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.479+0000 7fb3e1688700 1 Processor -- start 2023-08-09T14:15:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.479+0000 7fb3e1688700 1 -- start start 2023-08-09T14:15:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3e1688700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3e1688700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 0x7fb3dc0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3e1688700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0d0760 con 0x7fb3dc15d5d0 2023-08-09T14:15:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3e1688700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b00d0 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3e1688700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0ce7f0 con 0x7fb3dc0b2130 2023-08-09T14:15:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3daffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3dc15d5d0 0x7fb3dc0d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56012/0 (socket says 172.21.15.5:56012) 2023-08-09T14:15:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3daffd700 1 -- 172.21.15.5:0/1773496325 learned_addr learned my addr 172.21.15.5:0/1773496325 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3db7fe700 1 --2- 172.21.15.5:0/1773496325 >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 0x7fb3dc0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/1773496325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3d9ffb700 1 -- 172.21.15.5:0/1773496325 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964183827 0 0) 0x7fb3dc0d0760 con 0x7fb3dc15d5d0 2023-08-09T14:15:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3d9ffb700 1 -- 172.21.15.5:0/1773496325 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c40035b0 con 0x7fb3dc15d5d0 2023-08-09T14:15:32.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3da7fc700 1 -- 172.21.15.5:0/1773496325 >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 msgr2=0x7fb3dc0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:32.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/1773496325 >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 0x7fb3dc0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3da7fc700 1 -- 172.21.15.5:0/1773496325 >> v1:172.21.15.5:6789/0 conn(0x7fb3dc15d5d0 legacy=0x7fb3dc0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3da7fc700 1 -- 172.21.15.5:0/1773496325 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0afd60 con 0x7fb3dc0b2130 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.480+0000 7fb3db7fe700 1 --2- 172.21.15.5:0/1773496325 >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 0x7fb3dc0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/1773496325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0d16a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009840 tx=0x7fb3cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0eeab09c6865192 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3d9ffb700 1 -- 172.21.15.5:0/1773496325 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011830 con 0x7fb3dc0b2130 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3d9ffb700 1 -- 172.21.15.5:0/1773496325 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc011990 con 0x7fb3dc0b2130 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3d9ffb700 1 -- 172.21.15.5:0/1773496325 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011d20 con 0x7fb3dc0b2130 2023-08-09T14:15:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 -- 172.21.15.5:0/1773496325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 msgr2=0x7fb3dc0d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 --2- 172.21.15.5:0/1773496325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0d16a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009840 tx=0x7fb3cc009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 -- 172.21.15.5:0/1773496325 shutdown_connections 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 --2- 172.21.15.5:0/1773496325 >> v2:172.21.15.101:3300/0 conn(0x7fb3dc0b04f0 0x7fb3dc0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 --2- 172.21.15.5:0/1773496325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0d16a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 -- 172.21.15.5:0/1773496325 >> 172.21.15.5:0/1773496325 conn(0x7fb3dc0d3090 msgr2=0x7fb3dc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 -- 172.21.15.5:0/1773496325 shutdown_connections 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.481+0000 7fb3e1688700 1 -- 172.21.15.5:0/1773496325 wait complete. 2023-08-09T14:15:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 Processor -- start 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 -- start start 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc15d5d0 0x7fb3dc0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15fda0 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc160080 con 0x7fb3dc15d5d0 2023-08-09T14:15:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3e1688700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c6bc0 con 0x7fb3dc0b2130 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3daffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3daffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42602/0 (socket says 172.21.15.5:42602) 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.483+0000 7fb3daffd700 1 -- 172.21.15.5:0/3713541539 learned_addr learned my addr 172.21.15.5:0/3713541539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3db7fe700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc15d5d0 0x7fb3dc0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 -- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 msgr2=0x7fb3dc0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 -- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc15d5d0 msgr2=0x7fb3dc0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc15d5d0 0x7fb3dc0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 -- 172.21.15.5:0/3713541539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009a70 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3daffd700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c700 tx=0x7fb3d000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0005d70 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d00070d0 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0094a0 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007460 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.484+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0c7180 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.485+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc074600 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.486+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3d00075c0 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.486+0000 7fb3c37fe700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 0x7fb3c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.486+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3d0087a20 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.486+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 0x7fb3c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.487+0000 7fb3da7fc700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 0x7fb3c806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b2570 tx=0x7fb3cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.490+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb3d0053110 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.690+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3dc1e7f80 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.691+0000 7fb3c37fe700 1 -- 172.21.15.5:0/3713541539 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fb3d0056730 con 0x7fb3dc0b04f0 2023-08-09T14:15:32.694 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:32.694 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 msgr2=0x7fb3c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 0x7fb3c806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b2570 tx=0x7fb3cc008030 comp rx=0 tx=0).stop 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 msgr2=0x7fb3dc0b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c700 tx=0x7fb3d000ca10 comp rx=0 tx=0).stop 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 shutdown_connections 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3c806a0e0 0x7fb3c806c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc15d5d0 0x7fb3dc0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0b04f0 0x7fb3dc0b5e70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 --2- 172.21.15.5:0/3713541539 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc0b2130 0x7fb3dc0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 >> 172.21.15.5:0/3713541539 conn(0x7fb3dc0d3090 msgr2=0x7fb3dc0b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 shutdown_connections 2023-08-09T14:15:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.693+0000 7fb3e1688700 1 -- 172.21.15.5:0/3713541539 wait complete. 2023-08-09T14:15:32.708 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-09T14:15:32.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.832+0000 7f5bc618b700 1 Processor -- start 2023-08-09T14:15:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.832+0000 7f5bc618b700 1 -- start start 2023-08-09T14:15:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc00ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bc00cef40 0x7f5bc0071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f5bc0071dd0 0x7f5bc006a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00cf3c0 con 0x7f5bc00cef40 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00ca5c0 con 0x7f5bc0071dd0 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bc618b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00cdea0 con 0x7f5bc006b920 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bc00cef40 0x7f5bc0071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bc00cef40 0x7f5bc0071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42612/0 (socket says 172.21.15.5:42612) 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 -- 172.21.15.5:0/3251707555 learned_addr learned my addr 172.21.15.5:0/3251707555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbffff700 1 --2- 172.21.15.5:0/3251707555 >> v2:172.21.15.101:3300/0 conn(0x7f5bc0071dd0 0x7f5bc006a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbf7fe700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc00ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 -- 172.21.15.5:0/3251707555 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 msgr2=0x7f5bc00ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc00ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 -- 172.21.15.5:0/3251707555 >> v2:172.21.15.101:3300/0 conn(0x7f5bc0071dd0 msgr2=0x7f5bc006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/3251707555 >> v2:172.21.15.101:3300/0 conn(0x7f5bc0071dd0 0x7f5bc006a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbeffd700 1 -- 172.21.15.5:0/3251707555 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00ce460 con 0x7f5bc00cef40 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.833+0000 7f5bbf7fe700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc00ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc00cef40 0x7f5bc0071890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00ca0b0 tx=0x7f5bb400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf5d2dbd3f8eb59 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bbe7fc700 1 -- 172.21.15.5:0/3251707555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400cb70 con 0x7f5bc00cef40 2023-08-09T14:15:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bbe7fc700 1 -- 172.21.15.5:0/3251707555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400ccd0 con 0x7f5bc00cef40 2023-08-09T14:15:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bbe7fc700 1 -- 172.21.15.5:0/3251707555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4018620 con 0x7f5bc00cef40 2023-08-09T14:15:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 -- 172.21.15.5:0/3251707555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc00cef40 msgr2=0x7f5bc0071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc00cef40 0x7f5bc0071890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00ca0b0 tx=0x7f5bb400ad70 comp rx=0 tx=0).stop 2023-08-09T14:15:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 -- 172.21.15.5:0/3251707555 shutdown_connections 2023-08-09T14:15:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 --2- 172.21.15.5:0/3251707555 >> v2:172.21.15.101:3300/0 conn(0x7f5bc0071dd0 0x7f5bc006a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc00ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 --2- 172.21.15.5:0/3251707555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc00cef40 0x7f5bc0071890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 -- 172.21.15.5:0/3251707555 >> 172.21.15.5:0/3251707555 conn(0x7f5bc00cf560 msgr2=0x7f5bc00cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 -- 172.21.15.5:0/3251707555 shutdown_connections 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.834+0000 7f5bc618b700 1 -- 172.21.15.5:0/3251707555 wait complete. 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.836+0000 7f5bc618b700 1 Processor -- start 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.836+0000 7f5bc618b700 1 -- start start 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc01ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5bc00cef40 0x7f5bc014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc014ecc0 con 0x7f5bc0071dd0 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc014efa0 con 0x7f5bc00cef40 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bc618b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc014f280 con 0x7f5bc006b920 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42618/0 (socket says 172.21.15.5:42618) 2023-08-09T14:15:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bbeffd700 1 -- 172.21.15.5:0/1101622103 learned_addr learned my addr 172.21.15.5:0/1101622103 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bbffff700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5bc00cef40 0x7f5bc014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.837+0000 7f5bbf7fe700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc01ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 -- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 msgr2=0x7f5bc01ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc01ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 -- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5bc00cef40 msgr2=0x7f5bc014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5bc00cef40 0x7f5bc014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 -- 172.21.15.5:0/1101622103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb400a6f0 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bbeffd700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000c00 tx=0x7f5bb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb401f070 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40038b0 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4003c80 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc014f560 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.838+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc014e7e0 con 0x7f5bc0071dd0 2023-08-09T14:15:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.839+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc014fa80 con 0x7f5bc0071dd0 2023-08-09T14:15:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.839+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5bb401a610 con 0x7f5bc0071dd0 2023-08-09T14:15:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.840+0000 7f5ba7fff700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 0x7f5bac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.840+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bb408b460 con 0x7f5bc0071dd0 2023-08-09T14:15:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.840+0000 7f5bbf7fe700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 0x7f5bac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.840+0000 7f5bbf7fe700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 0x7f5bac06c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0006ba0 tx=0x7f5bb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:32.844+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5bc014fa80 con 0x7f5bc0071dd0 2023-08-09T14:15:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.045+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bc014fa80 con 0x7f5bc0071dd0 2023-08-09T14:15:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.046+0000 7f5ba7fff700 1 -- 172.21.15.5:0/1101622103 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f5bc014fa80 con 0x7f5bc0071dd0 2023-08-09T14:15:33.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:33.049 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:33.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 msgr2=0x7f5bac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 0x7f5bac06c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0006ba0 tx=0x7f5bb0008040 comp rx=0 tx=0).stop 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 msgr2=0x7f5bc01efd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000c00 tx=0x7f5bb4004750 comp rx=0 tx=0).stop 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 shutdown_connections 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5bac06a0e0 0x7f5bac06c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5bc00cef40 0x7f5bc014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5bc006b920 0x7f5bc01ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 --2- 172.21.15.5:0/1101622103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc0071dd0 0x7f5bc01efd70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 >> 172.21.15.5:0/1101622103 conn(0x7f5bc00cf560 msgr2=0x7f5bc015c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 shutdown_connections 2023-08-09T14:15:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.048+0000 7f5bc618b700 1 -- 172.21.15.5:0/1101622103 wait complete. 2023-08-09T14:15:33.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-09T14:15:33.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-09T14:15:33.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-09T14:15:33.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-09T14:15:33.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-09T14:15:33.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-09T14:15:33.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-09T14:15:33.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-09T14:15:33.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.282+0000 7f106175f700 1 Processor -- start 2023-08-09T14:15:33.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.282+0000 7f106175f700 1 -- start start 2023-08-09T14:15:33.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.281+0000 7f839fc3a700 1 Processor -- start 2023-08-09T14:15:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.283+0000 7f839fc3a700 1 -- start start 2023-08-09T14:15:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f839fc3a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8398161640 0x7f83980b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f839fc3a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f8398165960 0x7f83980ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f839fc3a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83980cbf60 con 0x7f83980cbaa0 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f839fc3a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980c9430 con 0x7f8398161640 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f839fc3a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980c9710 con 0x7f8398165960 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839d1d5700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f83980cbaa0 0x7f8398165250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37392/0 (socket says 172.21.15.5:37392) 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839d1d5700 1 -- 172.21.15.5:0/220350587 learned_addr learned my addr 172.21.15.5:0/220350587 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839e1d7700 1 --2- 172.21.15.5:0/220350587 >> v2:172.21.15.101:3300/0 conn(0x7f8398165960 0x7f83980ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839e1d7700 1 -- 172.21.15.5:0/220350587 >> v2:172.21.15.5:3300/0 conn(0x7f8398161640 msgr2=0x7f83980b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839e1d7700 1 --2- 172.21.15.5:0/220350587 >> v2:172.21.15.5:3300/0 conn(0x7f8398161640 0x7f83980b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839e1d7700 1 -- 172.21.15.5:0/220350587 >> v1:172.21.15.101:6789/0 conn(0x7f83980cbaa0 legacy=0x7f8398165250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f839e1d7700 1 -- 172.21.15.5:0/220350587 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980ce8e0 con 0x7f8398165960 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f839e1d7700 1 --2- 172.21.15.5:0/220350587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f83980ccad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83980c1ca0 tx=0x7f839000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24770645f29e4af0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f839c9d4700 1 -- 172.21.15.5:0/220350587 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000e070 con 0x7f8398165960 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f839c9d4700 1 -- 172.21.15.5:0/220350587 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000bad0 con 0x7f8398165960 2023-08-09T14:15:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f839c9d4700 1 -- 172.21.15.5:0/220350587 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000be80 con 0x7f8398165960 2023-08-09T14:15:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f9230e5c700 1 Processor -- start 2023-08-09T14:15:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f9230e5c700 1 -- start start 2023-08-09T14:15:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f9230e5c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f922c15b1e0 0x7f922c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f9230e5c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f922c0b3160 0x7f922c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f9230e5c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0cd880 con 0x7f922c0cb590 2023-08-09T14:15:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f9230e5c700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c0d1e50 con 0x7f922c15b1e0 2023-08-09T14:15:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7f9230e5c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0cd5c0 con 0x7f922c0b3160 2023-08-09T14:15:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f922ad9d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f922c0b3160 0x7f922c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f9229d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f922c0cb590 0x7f922c0b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56060/0 (socket says 172.21.15.5:56060) 2023-08-09T14:15:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f9229d9b700 1 -- 172.21.15.5:0/2455969604 learned_addr learned my addr 172.21.15.5:0/2455969604 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 -- 172.21.15.5:0/220350587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 msgr2=0x7f83980ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 --2- 172.21.15.5:0/220350587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f83980ccad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83980c1ca0 tx=0x7f839000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 -- 172.21.15.5:0/220350587 shutdown_connections 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 --2- 172.21.15.5:0/220350587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f83980ccad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 --2- 172.21.15.5:0/220350587 >> v2:172.21.15.5:3300/0 conn(0x7f8398161640 0x7f83980b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f839fc3a700 1 -- 172.21.15.5:0/220350587 >> 172.21.15.5:0/220350587 conn(0x7f83980b0850 msgr2=0x7f83980b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014062138 0 0) 0x7f922c0cd880 con 0x7f922c0cb590 2023-08-09T14:15:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92140035b0 con 0x7f922c0cb590 2023-08-09T14:15:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.283+0000 7f106175f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f105c161860 0x7f105c1652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.283+0000 7f106175f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c06b270 con 0x7f105c0cd130 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.283+0000 7f106175f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0c2b00 con 0x7f105c0cbb20 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.283+0000 7f106175f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c161c40 con 0x7f105c161860 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f105a7fc700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f105c0cbb20 0x7f105c1657f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37388/0 (socket says 172.21.15.5:37388) 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7f105a7fc700 1 -- 172.21.15.5:0/1725357656 learned_addr learned my addr 172.21.15.5:0/1725357656 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828771792 0 0) 0x7f105c0c2b00 con 0x7f105c0cbb20 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.285+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10440035b0 con 0x7f105c0cbb20 2023-08-09T14:15:33.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826219494 0 0) 0x7f105c06b270 con 0x7f105c0cd130 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f105c0c2b00 con 0x7f105c0cd130 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.1 v1:172.21.15.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943363197 0 0) 0x7f10440035b0 con 0x7f105c0cbb20 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 >> v2:172.21.15.101:3300/0 conn(0x7f105c161860 msgr2=0x7f105c1652b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 --2- 172.21.15.5:0/1725357656 >> v2:172.21.15.101:3300/0 conn(0x7f105c161860 0x7f105c1652b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 >> v1:172.21.15.5:6789/0 conn(0x7f105c0cd130 legacy=0x7f105c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> v1:172.21.15.101:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c06b4e0 con 0x7f105c0cbb20 2023-08-09T14:15:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.1 v1:172.21.15.101:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f104c0015f0 con 0x7f105c0cbb20 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 >> v1:172.21.15.101:6789/0 conn(0x7f105c0cbb20 legacy=0x7f105c1657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1044003b90 0x7f1044003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1044004850 0x7f1044004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1044005260 0x7f104400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c161c40 con 0x7f1044004850 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104400c1b0 con 0x7f1044005260 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104400c370 con 0x7f1044003b90 2023-08-09T14:15:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.287+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1044004850 0x7f1044004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 -- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1044003b90 msgr2=0x7f1044003f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1044003b90 0x7f1044003f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 -- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1044005260 msgr2=0x7f104400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1044005260 0x7f104400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 -- 172.21.15.5:0/1725357656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c06b4e0 con 0x7f1044004850 2023-08-09T14:15:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1044004850 0x7f1044004cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104c02e2a0 tx=0x7f1044005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a283aa325dceed server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784109578 0 0) 0x7f92140035b0 con 0x7f922c0cb590 2023-08-09T14:15:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f922c0b3160 msgr2=0x7f922c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f922c0b3160 0x7f922c15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 >> v2:172.21.15.101:3300/0 conn(0x7f922c15b1e0 msgr2=0x7f922c0cd080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 --2- 172.21.15.5:0/2455969604 >> v2:172.21.15.101:3300/0 conn(0x7f922c15b1e0 0x7f922c0cd080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c06f7e0 con 0x7f922c0cb590 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f921c001670 con 0x7f922c0cb590 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 >> v1:172.21.15.5:6789/0 conn(0x7f922c0cb590 legacy=0x7f922c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9214003a00 0x7f9214003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9214004850 0x7f9214004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214005330 0x7f921400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0d1e50 con 0x7f9214004850 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0cd5c0 con 0x7f9214003a00 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921400c240 con 0x7f9214005330 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7f9229d9b700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9214004850 0x7f9214004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7efc47dba700 1 Processor -- start 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.284+0000 7efc47dba700 1 -- start start 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc47dba700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 0x7efc4006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc47dba700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc47dba700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc400b1600 con 0x7efc4016a1c0 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc47dba700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc400cb470 con 0x7efc40169de0 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc47dba700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400cb750 con 0x7efc400caf90 2023-08-09T14:15:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc45355700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc45355700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60448/0 (socket says 172.21.15.5:60448) 2023-08-09T14:15:33.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.286+0000 7efc45355700 1 -- 172.21.15.5:0/945997117 learned_addr learned my addr 172.21.15.5:0/945997117 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7fea571ee700 1 Processor -- start 2023-08-09T14:15:33.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7fea571ee700 1 -- start start 2023-08-09T14:15:33.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.288+0000 7efc45b56700 1 --2- 172.21.15.5:0/945997117 >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 0x7efc4006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728987834 0 0) 0x7efc400b1600 con 0x7efc4016a1c0 2023-08-09T14:15:33.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f922ad9d700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214005330 0x7f921400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 -- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214005330 msgr2=0x7f921400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214005330 0x7f921400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 -- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9214003a00 msgr2=0x7f9214003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9214003a00 0x7f9214003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 -- 172.21.15.5:0/2455969604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140035b0 con 0x7f9214004850 2023-08-09T14:15:33.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f839fc3a700 1 -- 172.21.15.5:0/220350587 shutdown_connections 2023-08-09T14:15:33.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f9229d9b700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9214004850 0x7f9214004cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c240 tx=0x7f9214005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f5c44764b1587 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f839fc3a700 1 -- 172.21.15.5:0/220350587 wait complete. 2023-08-09T14:15:33.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00cd80 con 0x7f9214004850 2023-08-09T14:15:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c005960 con 0x7f9214004850 2023-08-09T14:15:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7f922959a700 1 -- 172.21.15.5:0/2455969604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c005d10 con 0x7f9214004850 2023-08-09T14:15:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.289+0000 7fea571ee700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fea5016a1a0 0x7fea500cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea571ee700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea5008a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea571ee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5006fd70 con 0x7fea500ce0c0 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea571ee700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500cc1a0 con 0x7fea5016a1a0 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea571ee700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500ce520 con 0x7fea500ccf40 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea4ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea500ce0c0 0x7fea500cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56070/0 (socket says 172.21.15.5:56070) 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea4ffff700 1 -- 172.21.15.5:0/2459126180 learned_addr learned my addr 172.21.15.5:0/2459126180 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea54f8a700 1 --2- 172.21.15.5:0/2459126180 >> v2:172.21.15.101:3300/0 conn(0x7fea5016a1a0 0x7fea500cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f9230e5c700 1 -- 172.21.15.5:0/2455969604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9214004850 msgr2=0x7f9214004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f9230e5c700 1 --2- 172.21.15.5:0/2455969604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9214004850 0x7f9214004cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c240 tx=0x7f9214005880 comp rx=0 tx=0).stop 2023-08-09T14:15:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f922ad9d700 1 -- 172.21.15.5:0/2455969604 reap_dead start 2023-08-09T14:15:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea54f8a700 1 -- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 msgr2=0x7fea5008a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea54f8a700 1 --2- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea5008a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea54f8a700 1 -- 172.21.15.5:0/2459126180 >> v1:172.21.15.5:6789/0 conn(0x7fea500ce0c0 legacy=0x7fea500cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7fea54f8a700 1 -- 172.21.15.5:0/2459126180 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500c93e0 con 0x7fea5016a1a0 2023-08-09T14:15:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c007bc0 con 0x7f1044004850 2023-08-09T14:15:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c02ebe0 con 0x7f1044004850 2023-08-09T14:15:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.290+0000 7f1059ffb700 1 -- 172.21.15.5:0/1725357656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c005960 con 0x7f1044004850 2023-08-09T14:15:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7f106175f700 1 -- 172.21.15.5:0/1725357656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1044004850 msgr2=0x7f1044004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7f106175f700 1 --2- 172.21.15.5:0/1725357656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1044004850 0x7f1044004cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104c02e2a0 tx=0x7f1044005880 comp rx=0 tx=0).stop 2023-08-09T14:15:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7fea54f8a700 1 --2- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea5016a1a0 0x7fea500cbaa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea4800bd70 tx=0x7fea48009540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9835f4d39c0ae53 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7f839fc3a700 1 Processor -- start 2023-08-09T14:15:33.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7f839fc3a700 1 -- start start 2023-08-09T14:15:33.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7fea4f7fe700 1 -- 172.21.15.5:0/2459126180 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48009fe0 con 0x7fea5016a1a0 2023-08-09T14:15:33.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc2c003e40 con 0x7efc4016a1c0 2023-08-09T14:15:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7fea4f7fe700 1 -- 172.21.15.5:0/2459126180 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea48019850 con 0x7fea5016a1a0 2023-08-09T14:15:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7fea4f7fe700 1 -- 172.21.15.5:0/2459126180 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48019c00 con 0x7fea5016a1a0 2023-08-09T14:15:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc45355700 1 -- 172.21.15.5:0/945997117 >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 msgr2=0x7efc4006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc45355700 1 --2- 172.21.15.5:0/945997117 >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 0x7efc4006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc45355700 1 -- 172.21.15.5:0/945997117 >> v1:172.21.15.101:6789/0 conn(0x7efc4016a1c0 legacy=0x7efc4008a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 <== mon.1 v1:172.21.15.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2388531663 0 0) 0x7efc2c003e40 con 0x7efc4016a1c0 2023-08-09T14:15:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7efc45355700 1 -- 172.21.15.5:0/945997117 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400cba30 con 0x7efc400caf90 2023-08-09T14:15:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.291+0000 7f839fc3a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83980cbaa0 0x7f83980b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839fc3a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8398161640 0x7f839815f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839fc3a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f839815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839fc3a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980b4260 con 0x7f83980cbaa0 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839fc3a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980b3f80 con 0x7f8398165960 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839fc3a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980c2670 con 0x7f8398161640 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7efc45355700 1 --2- 172.21.15.5:0/945997117 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0098f0 tx=0x7efc3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f969cd5b3caf00ec server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7efc45b56700 1 --2- 172.21.15.5:0/945997117 >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 0x7efc4006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f839815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839d1d5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8398161640 0x7f839815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f839815f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59704/0 (socket says 172.21.15.5:59704) 2023-08-09T14:15:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 -- 172.21.15.5:0/1567548127 learned_addr learned my addr 172.21.15.5:0/1567548127 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380019f0 con 0x7efc400caf90 2023-08-09T14:15:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c013a90 con 0x7efc400caf90 2023-08-09T14:15:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 -- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea5016a1a0 msgr2=0x7fea500cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 --2- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea5016a1a0 0x7fea500cbaa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea4800bd70 tx=0x7fea48009540 comp rx=0 tx=0).stop 2023-08-09T14:15:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7efc44b54700 1 -- 172.21.15.5:0/945997117 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c013e00 con 0x7efc400caf90 2023-08-09T14:15:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f9230e5c700 1 -- 172.21.15.5:0/2455969604 shutdown_connections 2023-08-09T14:15:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f9230e5c700 1 -- 172.21.15.5:0/2455969604 >> 172.21.15.5:0/2455969604 conn(0x7f922c0d0fd0 msgr2=0x7f922c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 -- 172.21.15.5:0/2459126180 shutdown_connections 2023-08-09T14:15:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 --2- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea5008a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 --2- 172.21.15.5:0/2459126180 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea5016a1a0 0x7fea500cbaa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 -- 172.21.15.5:0/2459126180 >> 172.21.15.5:0/2459126180 conn(0x7fea500b0850 msgr2=0x7fea500b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839d9d6700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83980cbaa0 0x7f83980b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 -- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8398161640 msgr2=0x7f839815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8398161640 0x7f839815f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 -- 172.21.15.5:0/1567548127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83980cbaa0 msgr2=0x7f83980b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 -- 172.21.15.5:0/2459126180 shutdown_connections 2023-08-09T14:15:33.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7fea571ee700 1 -- 172.21.15.5:0/2459126180 wait complete. 2023-08-09T14:15:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83980cbaa0 0x7f83980b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839e1d7700 1 -- 172.21.15.5:0/1567548127 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009a70 con 0x7f8398165960 2023-08-09T14:15:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.292+0000 7f839d9d6700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83980cbaa0 0x7f83980b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f839e1d7700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f839815f970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8390004000 tx=0x7f8390004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f050d258700 1 Processor -- start 2023-08-09T14:15:33.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f9230e5c700 1 -- 172.21.15.5:0/2455969604 shutdown_connections 2023-08-09T14:15:33.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f9230e5c700 1 -- 172.21.15.5:0/2455969604 wait complete. 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 -- 172.21.15.5:0/945997117 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 msgr2=0x7efc400ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 --2- 172.21.15.5:0/945997117 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0098f0 tx=0x7efc3c009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 -- 172.21.15.5:0/945997117 shutdown_connections 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 --2- 172.21.15.5:0/945997117 >> v2:172.21.15.101:3300/0 conn(0x7efc40169de0 0x7efc4006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 --2- 172.21.15.5:0/945997117 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc400caf90 0x7efc400ce0c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7efc47dba700 1 -- 172.21.15.5:0/945997117 >> 172.21.15.5:0/945997117 conn(0x7efc400b0850 msgr2=0x7efc400b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7efc47dba700 1 -- 172.21.15.5:0/945997117 shutdown_connections 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390004820 con 0x7f8398165960 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839001e430 con 0x7f8398165960 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839001e7e0 con 0x7f8398165960 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980c2950 con 0x7f8398165960 2023-08-09T14:15:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980b3b50 con 0x7f8398165960 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f050d258700 1 -- start start 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f050d258700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0508159990 0x7f05080cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f050d258700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f05080c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f050d258700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080c9c50 con 0x7f05080c92b0 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f050d258700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0508150900 con 0x7f0508159990 2023-08-09T14:15:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f050d258700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050815dee0 con 0x7f05080cbed0 2023-08-09T14:15:33.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7fea571ee700 1 Processor -- start 2023-08-09T14:15:33.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f0506d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0508159990 0x7f05080cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f0506d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0508159990 0x7f05080cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42664/0 (socket says 172.21.15.5:42664) 2023-08-09T14:15:33.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7f0506d9d700 1 -- 172.21.15.5:0/3417836077 learned_addr learned my addr 172.21.15.5:0/3417836077 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.294+0000 7efc47dba700 1 -- 172.21.15.5:0/945997117 wait complete. 2023-08-09T14:15:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7efc47dba700 1 Processor -- start 2023-08-09T14:15:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f9230e5c700 1 Processor -- start 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f105b7fe700 1 -- 172.21.15.5:0/1725357656 reap_dead start 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.293+0000 7f105b7fe700 1 -- 172.21.15.5:0/1725357656 reap_dead start 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f106175f700 1 -- 172.21.15.5:0/1725357656 shutdown_connections 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f106175f700 1 -- 172.21.15.5:0/1725357656 >> 172.21.15.5:0/1725357656 conn(0x7f105c0cf560 msgr2=0x7f105c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7fea571ee700 1 -- start start 2023-08-09T14:15:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7fea571ee700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea501670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7fea571ee700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea500ce0c0 0x7fea500c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7fea571ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea5016a1a0 0x7fea500b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7fea571ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b15f0 con 0x7fea5016a1a0 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea571ee700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b4ca0 con 0x7fea500ce0c0 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea571ee700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b17e0 con 0x7fea500ccf40 2023-08-09T14:15:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7efc47dba700 1 -- start start 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc400caf90 0x7efc400c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 0x7efc40207130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc4016a1c0 0x7efc400c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4016d350 con 0x7efc400caf90 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c63a0 con 0x7efc4016a1c0 2023-08-09T14:15:33.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc47dba700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c6680 con 0x7efc40169de0 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0506d9d700 1 -- 172.21.15.5:0/3417836077 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 msgr2=0x7f05080c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0506d9d700 1 --2- 172.21.15.5:0/3417836077 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f05080c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0506d9d700 1 -- 172.21.15.5:0/3417836077 >> v1:172.21.15.101:6789/0 conn(0x7f05080c92b0 legacy=0x7f05080cb7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0506d9d700 1 -- 172.21.15.5:0/3417836077 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080ccd70 con 0x7f0508159990 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0506d9d700 1 --2- 172.21.15.5:0/3417836077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080cc830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04f800a990 tx=0x7f04f8010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b614e0c3d1100c9e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.295+0000 7f0505d9b700 1 -- 172.21.15.5:0/3417836077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800ace0 con 0x7f0508159990 2023-08-09T14:15:33.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f839001e940 con 0x7f8398165960 2023-08-09T14:15:33.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f838e7fc700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f838406a310 0x7f838406c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f839008aa00 con 0x7f8398165960 2023-08-09T14:15:33.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea54f8a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea501670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea54f8a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea501670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea54f8a700 1 -- 172.21.15.5:0/575319516 learned_addr learned my addr 172.21.15.5:0/575319516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea5578b700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea5016a1a0 0x7fea500b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea500ce0c0 0x7fea500c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f0505d9b700 1 -- 172.21.15.5:0/3417836077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800ae40 con 0x7f0508159990 2023-08-09T14:15:33.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f0505d9b700 1 -- 172.21.15.5:0/3417836077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8005c60 con 0x7f0508159990 2023-08-09T14:15:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 -- 172.21.15.5:0/3417836077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 msgr2=0x7f05080cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 --2- 172.21.15.5:0/3417836077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080cc830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04f800a990 tx=0x7f04f8010730 comp rx=0 tx=0).stop 2023-08-09T14:15:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc45355700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 0x7efc40207130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc45355700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 0x7efc40207130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60492/0 (socket says 172.21.15.5:60492) 2023-08-09T14:15:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc45355700 1 -- 172.21.15.5:0/195849196 learned_addr learned my addr 172.21.15.5:0/195849196 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.296+0000 7f9230e5c700 1 -- start start 2023-08-09T14:15:33.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc46357700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc4016a1c0 0x7efc400c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f106175f700 1 -- 172.21.15.5:0/1725357656 shutdown_connections 2023-08-09T14:15:33.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 -- 172.21.15.5:0/3417836077 shutdown_connections 2023-08-09T14:15:33.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 --2- 172.21.15.5:0/3417836077 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f05080c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 --2- 172.21.15.5:0/3417836077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080cc830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f050d258700 1 -- 172.21.15.5:0/3417836077 >> 172.21.15.5:0/3417836077 conn(0x7f05080b0850 msgr2=0x7f05080b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 -- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 msgr2=0x7fea501670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea501670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 -- 172.21.15.5:0/575319516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea5016a1a0 msgr2=0x7fea500b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea5016a1a0 0x7fea500b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7fea4ffff700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4800b980 con 0x7fea500ce0c0 2023-08-09T14:15:33.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7efc45b56700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc400caf90 0x7efc400c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f050d258700 1 -- 172.21.15.5:0/3417836077 shutdown_connections 2023-08-09T14:15:33.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7fea5578b700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea5016a1a0 0x7fea500b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:33.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 -- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc4016a1c0 msgr2=0x7efc400c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc4016a1c0 0x7efc400c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 -- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc400caf90 msgr2=0x7efc400c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc400caf90 0x7efc400c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009550 con 0x7efc40169de0 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc45355700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 0x7efc40207130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc400cb890 tx=0x7efc3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0132e0 con 0x7efc40169de0 2023-08-09T14:15:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c013440 con 0x7efc40169de0 2023-08-09T14:15:33.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0036a0 con 0x7efc40169de0 2023-08-09T14:15:33.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f9230e5c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214004850 0x7f922c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f9230e5c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 0x7f922c1f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f9230e5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922c1fa3a0 0x7f922c1fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f9230e5c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1fad60 con 0x7f922c1fa3a0 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.297+0000 7f9230e5c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c15dd90 con 0x7f922c15bb00 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9230e5c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c15e070 con 0x7f9214004850 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 0x7f922c1f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 0x7f922c1f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59726/0 (socket says 172.21.15.5:59726) 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 -- 172.21.15.5:0/806541056 learned_addr learned my addr 172.21.15.5:0/806541056 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f922a59c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214004850 0x7f922c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 -- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214004850 msgr2=0x7f922c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9214004850 0x7f922c15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 -- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922c1fa3a0 msgr2=0x7f922c1fa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922c1fa3a0 0x7f922c1fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f9229d9b700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c15e350 con 0x7f922c15bb00 2023-08-09T14:15:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f106175f700 1 -- 172.21.15.5:0/1725357656 wait complete. 2023-08-09T14:15:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f050d258700 1 -- 172.21.15.5:0/3417836077 wait complete. 2023-08-09T14:15:33.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f839fc3a700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] conn(0x7f83800015e0 0x7f8380003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 --> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8380006bd0 con 0x7f83800015e0 2023-08-09T14:15:33.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7f839d1d5700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] conn(0x7f83800015e0 0x7f8380003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.299+0000 7f839d9d6700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f838406a310 0x7f838406c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7fea54f8a700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea500ccf40 0x7fea501670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7fea4ffff700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea500ce0c0 0x7fea500c4180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c8e0 tx=0x7fea4400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.299+0000 7f839d1d5700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] conn(0x7f83800015e0 0x7f8380003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc400c6960 con 0x7efc40169de0 2023-08-09T14:15:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.298+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc400c6f20 con 0x7efc40169de0 2023-08-09T14:15:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.299+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc400cbff0 con 0x7efc40169de0 2023-08-09T14:15:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.299+0000 7f9229d9b700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 0x7f922c1f9e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f921c001820 tx=0x7f921c001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0070d0 con 0x7f922c15bb00 2023-08-09T14:15:33.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c007230 con 0x7f922c15bb00 2023-08-09T14:15:33.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c15e630 con 0x7f922c15bb00 2023-08-09T14:15:33.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f106175f700 1 Processor -- start 2023-08-09T14:15:33.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0075c0 con 0x7f922c15bb00 2023-08-09T14:15:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== osd.4 v2:172.21.15.101:6816/3814712948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8380006bd0 con 0x7f83800015e0 2023-08-09T14:15:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc3c003800 con 0x7efc40169de0 2023-08-09T14:15:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7efc367fc700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efc2406a0e0 0x7efc2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc3c0895a0 con 0x7efc40169de0 2023-08-09T14:15:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7efc367fc700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] conn(0x7efc24072920 0x7efc24074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc240753f0 con 0x7efc24072920 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc3c08bc60 con 0x7efc40169de0 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7efc45b56700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efc2406a0e0 0x7efc2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7efc46357700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] conn(0x7efc24072920 0x7efc24074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c0c5ac0 con 0x7f922c15bb00 2023-08-09T14:15:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9210000fc0 con 0x7f922c15bb00 2023-08-09T14:15:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f050d258700 1 Processor -- start 2023-08-09T14:15:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f050d258700 1 -- start start 2023-08-09T14:15:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f05080c92b0 0x7f05080c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f0508153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c7330 con 0x7f0508159990 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508153970 con 0x7f05080c92b0 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050d258700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c4df0 con 0x7f05080cbed0 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f0506d9d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f05080c92b0 0x7f05080c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f0506d9d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f05080c92b0 0x7f05080c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59746/0 (socket says 172.21.15.5:59746) 2023-08-09T14:15:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f0506d9d700 1 -- 172.21.15.5:0/2303464768 learned_addr learned my addr 172.21.15.5:0/2303464768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050759e700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f050659c700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f0508153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7efc46357700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] conn(0x7efc24072920 0x7efc24074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 -- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f05080c92b0 msgr2=0x7f05080c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f05080c92b0 0x7f05080c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 -- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 msgr2=0x7f05080c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0508159990 0x7f05080c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f800a5a0 con 0x7f05080cbed0 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f050659c700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f0508153430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00b440 tx=0x7f04fc009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc011830 con 0x7f05080cbed0 2023-08-09T14:15:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc011990 con 0x7f05080cbed0 2023-08-09T14:15:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc011d40 con 0x7f05080cbed0 2023-08-09T14:15:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.303+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f921c019030 con 0x7f922c15bb00 2023-08-09T14:15:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== osd.0 v2:172.21.15.5:6800/2789981148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efc240753f0 con 0x7efc24072920 2023-08-09T14:15:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400e8c0 con 0x7fea500ce0c0 2023-08-09T14:15:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400ea20 con 0x7fea500ce0c0 2023-08-09T14:15:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400ed90 con 0x7fea500ce0c0 2023-08-09T14:15:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080c63a0 con 0x7f05080cbed0 2023-08-09T14:15:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea500b46e0 con 0x7fea500ce0c0 2023-08-09T14:15:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080c6ce0 con 0x7f05080cbed0 2023-08-09T14:15:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f921affd700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920c06a0e0 0x7f920c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f921c089590 con 0x7f922c15bb00 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f921affd700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] conn(0x7f920c0729a0 0x7f920c074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f920c075470 con 0x7f920c0729a0 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f921c08bbb0 con 0x7f922c15bb00 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f922ad9d700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] conn(0x7f920c0729a0 0x7f920c074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f839d9d6700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f838406a310 0x7f838406c7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7efc45b56700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efc2406a0e0 0x7efc2406c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc3000a1c0 tx=0x7efc3000a150 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f922ad9d700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] conn(0x7f920c0729a0 0x7f920c074dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f922a59c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920c06a0e0 0x7f920c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.300+0000 7f106175f700 1 -- start start 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f105c143680 0x7f105c0c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 0x7f105c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f105c14cbd0 0x7f105c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1515a0 con 0x7f105c150be0 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0c4970 con 0x7f105c143680 2023-08-09T14:15:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f106175f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c143a60 con 0x7f105c14cbd0 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f105a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 0x7f105c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f105a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 0x7f105c151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42692/0 (socket says 172.21.15.5:42692) 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.301+0000 7f105a7fc700 1 -- 172.21.15.5:0/1022877538 learned_addr learned my addr 172.21.15.5:0/1022877538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f105a7fc700 1 -- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f105c14cbd0 msgr2=0x7f105c14d080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f105c14cbd0 0x7f105c14d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f105a7fc700 1 -- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f105c143680 msgr2=0x7f105c0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f105c143680 0x7f105c0c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.302+0000 7f105a7fc700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0c3860 con 0x7f105c150be0 2023-08-09T14:15:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f105a7fc700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 0x7f105c151060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f104c006f90 tx=0x7f104c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f050815d640 con 0x7f05080cbed0 2023-08-09T14:15:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.304+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea500b4390 con 0x7fea500ce0c0 2023-08-09T14:15:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c004930 con 0x7f105c150be0 2023-08-09T14:15:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c004a90 con 0x7f105c150be0 2023-08-09T14:15:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0c3b40 con 0x7f105c150be0 2023-08-09T14:15:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7fa6cea8c700 1 Processor -- start 2023-08-09T14:15:33.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c004e00 con 0x7f105c150be0 2023-08-09T14:15:33.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c0c4600 con 0x7f105c150be0 2023-08-09T14:15:33.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f922a59c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920c06a0e0 0x7f920c06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f922c04ff30 tx=0x7f92200090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.305+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea500c99a0 con 0x7fea500ce0c0 2023-08-09T14:15:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== osd.1 v2:172.21.15.5:6809/2174485398 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f920c075470 con 0x7f920c0729a0 2023-08-09T14:15:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.306+0000 7fa6cea8c700 1 -- start start 2023-08-09T14:15:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6cea8c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81618e0 0x7fa6c80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6cea8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6c806a8d0 0x7fa6c81652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6cea8c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80cf790 con 0x7fa6c8161cc0 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6cea8c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80cfc20 con 0x7fa6c806a8d0 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6cea8c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80cf460 con 0x7fa6c81618e0 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6c7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6c8161cc0 0x7fa6c806a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56130/0 (socket says 172.21.15.5:56130) 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.307+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1139078567 learned_addr learned my addr 172.21.15.5:0/1139078567 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f103c000fc0 con 0x7f105c150be0 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6cd029700 1 --2- 172.21.15.5:0/1139078567 >> v2:172.21.15.5:3300/0 conn(0x7fa6c806a8d0 0x7fa6c81652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130556720 0 0) 0x7fa6c80cf790 con 0x7fa6c8161cc0 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b80035b0 con 0x7fa6c8161cc0 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17922656 0 0) 0x7fa6b80035b0 con 0x7fa6c8161cc0 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81618e0 msgr2=0x7fa6c80cd190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81618e0 0x7fa6c80cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 >> v2:172.21.15.5:3300/0 conn(0x7fa6c806a8d0 msgr2=0x7fa6c81652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1139078567 >> v2:172.21.15.5:3300/0 conn(0x7fa6c806a8d0 0x7fa6c81652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8071f10 con 0x7fa6c8161cc0 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fa6b4001670 con 0x7fa6c8161cc0 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 >> v1:172.21.15.5:6789/0 conn(0x7fa6c8161cc0 legacy=0x7fa6c806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8003a00 0x7fa6b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6b8004850 0x7fa6b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6b8005210 0x7fa6b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80cf460 con 0x7fa6b8005210 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b800c030 con 0x7fa6b8003a00 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.308+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b800c1f0 con 0x7fa6b8004850 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6cd029700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6b8005210 0x7fa6b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6b8004850 0x7fa6b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8003a00 msgr2=0x7fa6b8003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8003a00 0x7fa6b8003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1139078567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6b8005210 msgr2=0x7fa6b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6b8005210 0x7fa6b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1139078567 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8071f10 con 0x7fa6b8004850 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.309+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6b8004850 0x7fa6b8004cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c510 tx=0x7fa6b8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3228f3517459c0cf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005960 con 0x7fa6b8004850 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4005ac0 con 0x7fa6b8004850 2023-08-09T14:15:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1139078567 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005e70 con 0x7fa6b8004850 2023-08-09T14:15:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f104c03b070 con 0x7f105c150be0 2023-08-09T14:15:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f104806a0e0 0x7f104806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f104c0abec0 con 0x7f105c150be0 2023-08-09T14:15:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] conn(0x7f1048072920 0x7f1048074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10480753f0 con 0x7f1048072920 2023-08-09T14:15:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f105affd700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f104806a0e0 0x7f104806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.310+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f104c0ac360 con 0x7f105c150be0 2023-08-09T14:15:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6b8004850 msgr2=0x7fa6b8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7fa6cea8c700 1 --2- 172.21.15.5:0/1139078567 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6b8004850 0x7fa6b8004cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c510 tx=0x7fa6b8005880 comp rx=0 tx=0).stop 2023-08-09T14:15:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7fa6cd029700 1 -- 172.21.15.5:0/1139078567 reap_dead start 2023-08-09T14:15:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7f105b7fe700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] conn(0x7f1048072920 0x7f1048074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7f105affd700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f104806a0e0 0x7f104806c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f105c0aebe0 tx=0x7f1050006cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.311+0000 7f105b7fe700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] conn(0x7f1048072920 0x7f1048074d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.312+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== osd.2 v2:172.21.15.5:6824/4031924117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f10480753f0 con 0x7f1048072920 2023-08-09T14:15:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1139078567 shutdown_connections 2023-08-09T14:15:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1139078567 >> 172.21.15.5:0/1139078567 conn(0x7fa6c80b1900 msgr2=0x7fa6c80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea44016420 con 0x7fea500ce0c0 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea3c06a130 0x7fea3c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea44012070 con 0x7fea500ce0c0 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] conn(0x7fea3c0729f0 0x7fea3c074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea3c0754c0 con 0x7fea3c0729f0 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.313+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea440893b0 con 0x7fea500ce0c0 2023-08-09T14:15:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.314+0000 7fea5578b700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] conn(0x7fea3c0729f0 0x7fea3c074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.314+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f04fc01a400 con 0x7f05080cbed0 2023-08-09T14:15:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.314+0000 7f04ef7fe700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04f406a0e0 0x7f04f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.314+0000 7fea5578b700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] conn(0x7fea3c0729f0 0x7fea3c074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04fc088330 con 0x7f05080cbed0 2023-08-09T14:15:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1139078567 shutdown_connections 2023-08-09T14:15:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f04ef7fe700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] conn(0x7f04f4072920 0x7f04f4074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04f40753f0 con 0x7f04f4072920 2023-08-09T14:15:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04fc08a9f0 con 0x7f05080cbed0 2023-08-09T14:15:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f050759e700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] conn(0x7f04f4072920 0x7f04f4074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7f050759e700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] conn(0x7f04f4072920 0x7f04f4074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.316+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== osd.3 v2:172.21.15.5:6808/2836163092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f04f40753f0 con 0x7f04f4072920 2023-08-09T14:15:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.315+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1139078567 wait complete. 2023-08-09T14:15:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.317+0000 7fa6cea8c700 1 Processor -- start 2023-08-09T14:15:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7f0506d9d700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04f406a0e0 0x7f04f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fea54f8a700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea3c06a130 0x7fea3c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== osd.5 v2:172.21.15.101:6800/2298841735 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fea3c0754c0 con 0x7fea3c0729f0 2023-08-09T14:15:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.317+0000 7fa6cea8c700 1 -- start start 2023-08-09T14:15:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7f0506d9d700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04f406a0e0 0x7f04f406c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04f8010770 tx=0x7f04f8014000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8004850 0x7fa6c80b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 0x7fa6c80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c815d690 0x7fa6c815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c815f140 con 0x7fa6c80b44b0 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c815e830 con 0x7fa6b8004850 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6cea8c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80b56c0 con 0x7fa6c815d690 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 0x7fa6c80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 0x7fa6c80b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42736/0 (socket says 172.21.15.5:42736) 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.318+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1302731967 learned_addr learned my addr 172.21.15.5:0/1302731967 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6cc828700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8004850 0x7fa6c80b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c815d690 msgr2=0x7fa6c815db40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c815d690 0x7fa6c815db40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8004850 msgr2=0x7fa6c80b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6b8004850 0x7fa6c80b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c815ea80 con 0x7fa6c80b44b0 2023-08-09T14:15:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 0x7fa6c80b0350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400cb00 tx=0x7fa6b4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4004c80 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4004e00 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4007310 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.319+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c815ed60 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.320+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c80b0890 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.322+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6b4007470 con 0x7fa6c80b44b0 2023-08-09T14:15:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.322+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6c80cdcc0 con 0x7fa6c80b44b0 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.322+0000 7fa6c57fa700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6ac06a0b0 0x7fa6ac06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.323+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6b4089e90 con 0x7fa6c80b44b0 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.323+0000 7fa6c57fa700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] conn(0x7fa6ac0728f0 0x7fa6ac074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.323+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6ac0753c0 con 0x7fa6ac0728f0 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.323+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6b408c530 con 0x7fa6c80b44b0 2023-08-09T14:15:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.327+0000 7f920f6b8700 1 Processor -- start 2023-08-09T14:15:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.327+0000 7fea54f8a700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea3c06a130 0x7fea3c06c5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fea48000f80 tx=0x7fea4801b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.327+0000 7fa6cc828700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6ac06a0b0 0x7fa6ac06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.328+0000 7fa6cd029700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] conn(0x7fa6ac0728f0 0x7fa6ac074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.328+0000 7fa6cc828700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6ac06a0b0 0x7fa6ac06c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6c804ff30 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.328+0000 7fa6cd029700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] conn(0x7fa6ac0728f0 0x7fa6ac074d10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.329+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 --> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8380005cb0 con 0x7f83800015e0 2023-08-09T14:15:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.329+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== osd.6 v2:172.21.15.101:6808/3445198555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa6ac0753c0 con 0x7fa6ac0728f0 2023-08-09T14:15:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.330+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 --> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc400cbd10 con 0x7efc24072920 2023-08-09T14:15:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.330+0000 7f838e7fc700 1 -- 172.21.15.5:0/1567548127 <== osd.4 v2:172.21.15.101:6816/3814712948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8380005cb0 con 0x7f83800015e0 2023-08-09T14:15:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.330+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] conn(0x7f83800015e0 msgr2=0x7f8380003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6816/3814712948,v1:172.21.15.101:6817/3814712948] conn(0x7f83800015e0 0x7f8380003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7efc367fc700 1 -- 172.21.15.5:0/195849196 <== osd.0 v2:172.21.15.5:6800/2789981148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc38002070 con 0x7efc24072920 2023-08-09T14:15:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f838406a310 msgr2=0x7f838406c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f838406a310 0x7f838406c7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388008040 comp rx=0 tx=0).stop 2023-08-09T14:15:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 msgr2=0x7f839815f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 --2- 172.21.15.5:0/1567548127 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8398165960 0x7f839815f970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8390004000 tx=0x7f8390004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839e1d7700 1 -- 172.21.15.5:0/1567548127 reap_dead start 2023-08-09T14:15:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 shutdown_connections 2023-08-09T14:15:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 >> 172.21.15.5:0/1567548127 conn(0x7f83980b0850 msgr2=0x7f839815ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 shutdown_connections 2023-08-09T14:15:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f839fc3a700 1 -- 172.21.15.5:0/1567548127 wait complete. 2023-08-09T14:15:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.331+0000 7f920f6b8700 1 -- start start 2023-08-09T14:15:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9208161950 0x7f92080d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b10d0 0x7f92080b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f92080b5050 0x7f92081653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9208161d30 con 0x7f9208161950 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92080b0f00 con 0x7f92080b5050 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920f6b8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b54c0 con 0x7f92080b10d0 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920d454700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9208161950 0x7f92080d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920d454700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9208161950 0x7f92080d2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42744/0 (socket says 172.21.15.5:42744) 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.332+0000 7f920d454700 1 -- 172.21.15.5:0/2156516013 learned_addr learned my addr 172.21.15.5:0/2156516013 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920cc53700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b10d0 0x7f92080b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 -- 172.21.15.5:0/2156516013 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b10d0 msgr2=0x7f92080b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b10d0 0x7f92080b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 -- 172.21.15.5:0/2156516013 >> v2:172.21.15.101:3300/0 conn(0x7f92080b5050 msgr2=0x7f92081653a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 --2- 172.21.15.5:0/2156516013 >> v2:172.21.15.101:3300/0 conn(0x7f92080b5050 0x7f92081653a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 -- 172.21.15.5:0/2156516013 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080b1530 con 0x7f9208161950 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f920d454700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9208161950 0x7f92080d2b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f920808bfe0 tx=0x7f91f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a0f18872236e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f91fffff700 1 -- 172.21.15.5:0/2156516013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8011830 con 0x7f9208161950 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f91fffff700 1 -- 172.21.15.5:0/2156516013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8011990 con 0x7f9208161950 2023-08-09T14:15:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.333+0000 7f91fffff700 1 -- 172.21.15.5:0/2156516013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8011d20 con 0x7f9208161950 2023-08-09T14:15:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.334+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] conn(0x7efc24072920 msgr2=0x7efc24074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.334+0000 7efc47dba700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.5:6800/2789981148,v1:172.21.15.5:6801/2789981148] conn(0x7efc24072920 0x7efc24074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.335+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efc2406a0e0 msgr2=0x7efc2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.335+0000 7efc47dba700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efc2406a0e0 0x7efc2406c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc3000a1c0 tx=0x7efc3000a150 comp rx=0 tx=0).stop 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.335+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 msgr2=0x7efc40207130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.335+0000 7efc47dba700 1 --2- 172.21.15.5:0/195849196 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc40169de0 0x7efc40207130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc400cb890 tx=0x7efc3c004750 comp rx=0 tx=0).stop 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.335+0000 7efc46357700 1 -- 172.21.15.5:0/195849196 reap_dead start 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.338+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 shutdown_connections 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.338+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 >> 172.21.15.5:0/195849196 conn(0x7efc400b0850 msgr2=0x7efc40071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.338+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 shutdown_connections 2023-08-09T14:15:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.338+0000 7efc47dba700 1 -- 172.21.15.5:0/195849196 wait complete. 2023-08-09T14:15:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.339+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 --> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9210002d40 con 0x7f920c0729a0 2023-08-09T14:15:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.339+0000 7f921affd700 1 -- 172.21.15.5:0/806541056 <== osd.1 v2:172.21.15.5:6809/2174485398 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9210002d40 con 0x7f920c0729a0 2023-08-09T14:15:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] conn(0x7f920c0729a0 msgr2=0x7f920c074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.5:6809/2174485398,v1:172.21.15.5:6810/2174485398] conn(0x7f920c0729a0 0x7f920c074dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920c06a0e0 msgr2=0x7f920c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920c06a0e0 0x7f920c06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f922c04ff30 tx=0x7f92200090e0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 msgr2=0x7f922c1f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 --2- 172.21.15.5:0/806541056 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f922c15bb00 0x7f922c1f9e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f921c001820 tx=0x7f921c001930 comp rx=0 tx=0).stop 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f922ad9d700 1 -- 172.21.15.5:0/806541056 reap_dead start 2023-08-09T14:15:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 shutdown_connections 2023-08-09T14:15:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 >> 172.21.15.5:0/806541056 conn(0x7f922c0d0fd0 msgr2=0x7f922c158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 shutdown_connections 2023-08-09T14:15:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.340+0000 7f9230e5c700 1 -- 172.21.15.5:0/806541056 wait complete. 2023-08-09T14:15:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 -- 172.21.15.5:0/2156516013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9208161950 msgr2=0x7f92080d2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9208161950 0x7f92080d2b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f920808bfe0 tx=0x7f91f8009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 -- 172.21.15.5:0/2156516013 shutdown_connections 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 --2- 172.21.15.5:0/2156516013 >> v2:172.21.15.101:3300/0 conn(0x7f92080b5050 0x7f92081653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9208161950 0x7f92080d2b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 --2- 172.21.15.5:0/2156516013 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b10d0 0x7f92080b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 -- 172.21.15.5:0/2156516013 >> 172.21.15.5:0/2156516013 conn(0x7f92080cfb10 msgr2=0x7f92080cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 -- 172.21.15.5:0/2156516013 shutdown_connections 2023-08-09T14:15:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.344+0000 7f920f6b8700 1 -- 172.21.15.5:0/2156516013 wait complete. 2023-08-09T14:15:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.346+0000 7f920f6b8700 1 Processor -- start 2023-08-09T14:15:33.401 INFO:teuthology.orchestra.run.smithi005.stdout:60129542152 2023-08-09T14:15:33.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.346+0000 7f920f6b8700 1 -- start start 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92080b10d0 0x7f92080c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b5050 0x7f92081520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9208161950 0x7f9208152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b6a60 con 0x7f92080b10d0 2023-08-09T14:15:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b64a0 con 0x7f9208161950 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920f6b8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b6780 con 0x7f92080b5050 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920d454700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92080b10d0 0x7f92080c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920d454700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92080b10d0 0x7f92080c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42750/0 (socket says 172.21.15.5:42750) 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920d454700 1 -- 172.21.15.5:0/1145369309 learned_addr learned my addr 172.21.15.5:0/1145369309 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920cc53700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b5050 0x7f92081520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9208161950 0x7f9208152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 --> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f050815d360 con 0x7f04f4072920 2023-08-09T14:15:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 -- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b5050 msgr2=0x7f92081520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f92080b5050 0x7f92081520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 -- 172.21.15.5:0/1145369309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92080b10d0 msgr2=0x7f92080c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92080b10d0 0x7f92080c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.348+0000 7f920dc55700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f8009550 con 0x7f9208161950 2023-08-09T14:15:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f920dc55700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9208161950 0x7f9208152630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f920000bb00 tx=0x7f920000be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f04ef7fe700 1 -- 172.21.15.5:0/2303464768 <== osd.3 v2:172.21.15.5:6808/2836163092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0500009bb0 con 0x7f04f4072920 2023-08-09T14:15:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000c9b0 con 0x7f9208161950 2023-08-09T14:15:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920000cb10 con 0x7f9208161950 2023-08-09T14:15:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92080c5500 con 0x7f9208161950 2023-08-09T14:15:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] conn(0x7f04f4072920 msgr2=0x7f04f4074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.5:6808/2836163092,v1:172.21.15.5:6811/2836163092] conn(0x7f04f4072920 0x7f04f4074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04f406a0e0 msgr2=0x7f04f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04f406a0e0 0x7f04f406c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04f8010770 tx=0x7f04f8014000 comp rx=0 tx=0).stop 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 msgr2=0x7f0508153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f050d258700 1 --2- 172.21.15.5:0/2303464768 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f05080cbed0 0x7f0508153430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00b440 tx=0x7f04fc009f90 comp rx=0 tx=0).stop 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.350+0000 7f050759e700 1 -- 172.21.15.5:0/2303464768 reap_dead start 2023-08-09T14:15:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.350+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 shutdown_connections 2023-08-09T14:15:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.350+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 >> 172.21.15.5:0/2303464768 conn(0x7f05080b0850 msgr2=0x7f05081581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200014440 con 0x7f9208161950 2023-08-09T14:15:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.349+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92080c9960 con 0x7f9208161950 2023-08-09T14:15:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.350+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92080b0140 con 0x7f9208161950 2023-08-09T14:15:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.343+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 --> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f103c002d40 con 0x7f1048072920 2023-08-09T14:15:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f920001d3b0 con 0x7f9208161950 2023-08-09T14:15:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 shutdown_connections 2023-08-09T14:15:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f91ec06a0e0 0x7f91ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9200088250 con 0x7f9208161950 2023-08-09T14:15:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f920d454700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f91ec06a0e0 0x7f91ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] conn(0x7f91ec072920 0x7f91ec074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91ec0753f0 con 0x7f91ec072920 2023-08-09T14:15:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f920008a830 con 0x7f9208161950 2023-08-09T14:15:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.353+0000 7f920cc53700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] conn(0x7f91ec072920 0x7f91ec074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f10437fe700 1 -- 172.21.15.5:0/1022877538 <== osd.2 v2:172.21.15.5:6824/4031924117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f103c002d40 con 0x7f1048072920 2023-08-09T14:15:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f920cc53700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] conn(0x7f91ec072920 0x7f91ec074d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] conn(0x7f1048072920 msgr2=0x7f1048074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:6824/4031924117,v1:172.21.15.5:6825/4031924117] conn(0x7f1048072920 0x7f1048074d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f104806a0e0 msgr2=0x7f104806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f104806a0e0 0x7f104806c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f105c0aebe0 tx=0x7f1050006cd0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 msgr2=0x7f105c151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.354+0000 7f106175f700 1 --2- 172.21.15.5:0/1022877538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f105c150be0 0x7f105c151060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f104c006f90 tx=0x7f104c031000 comp rx=0 tx=0).stop 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.355+0000 7f105b7fe700 1 -- 172.21.15.5:0/1022877538 reap_dead start 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.355+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 shutdown_connections 2023-08-09T14:15:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.355+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 >> 172.21.15.5:0/1022877538 conn(0x7f105c0cf560 msgr2=0x7f105c151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.355+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 --> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea500c96c0 con 0x7fea3c0729f0 2023-08-09T14:15:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.355+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== osd.7 v2:172.21.15.101:6819/483537661 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f91ec0753f0 con 0x7f91ec072920 2023-08-09T14:15:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.356+0000 7fea4d7fa700 1 -- 172.21.15.5:0/575319516 <== osd.5 v2:172.21.15.101:6800/2298841735 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea400099c0 con 0x7fea3c0729f0 2023-08-09T14:15:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.356+0000 7f050d258700 1 -- 172.21.15.5:0/2303464768 wait complete. 2023-08-09T14:15:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.356+0000 7f920d454700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f91ec06a0e0 0x7f91ec06c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009130 tx=0x7f91f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.357+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 shutdown_connections 2023-08-09T14:15:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.357+0000 7f106175f700 1 -- 172.21.15.5:0/1022877538 wait complete. 2023-08-09T14:15:33.417 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-08-09T14:15:33.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] conn(0x7fea3c0729f0 msgr2=0x7fea3c074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6800/2298841735,v1:172.21.15.101:6801/2298841735] conn(0x7fea3c0729f0 0x7fea3c074e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea3c06a130 msgr2=0x7fea3c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea3c06a130 0x7fea3c06c5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fea48000f80 tx=0x7fea4801b000 comp rx=0 tx=0).stop 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea500ce0c0 msgr2=0x7fea500c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 --2- 172.21.15.5:0/575319516 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea500ce0c0 0x7fea500c4180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c8e0 tx=0x7fea4400cbf0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea5578b700 1 -- 172.21.15.5:0/575319516 reap_dead start 2023-08-09T14:15:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 shutdown_connections 2023-08-09T14:15:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.358+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 >> 172.21.15.5:0/575319516 conn(0x7fea500b0850 msgr2=0x7fea500c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.359+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 shutdown_connections 2023-08-09T14:15:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.359+0000 7fea571ee700 1 -- 172.21.15.5:0/575319516 wait complete. 2023-08-09T14:15:33.421 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-08-09T14:15:33.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-09T14:15:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.370+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 --> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6c815e2c0 con 0x7fa6ac0728f0 2023-08-09T14:15:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.370+0000 7fa6c57fa700 1 -- 172.21.15.5:0/1302731967 <== osd.6 v2:172.21.15.101:6808/3445198555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6c815e2c0 con 0x7fa6ac0728f0 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] conn(0x7fa6ac0728f0 msgr2=0x7fa6ac074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6808/3445198555,v1:172.21.15.101:6809/3445198555] conn(0x7fa6ac0728f0 0x7fa6ac074d10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6ac06a0b0 msgr2=0x7fa6ac06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6ac06a0b0 0x7fa6ac06c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6c804ff30 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 msgr2=0x7fa6c80b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 --2- 172.21.15.5:0/1302731967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80b44b0 0x7fa6c80b0350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400cb00 tx=0x7fa6b4001a00 comp rx=0 tx=0).stop 2023-08-09T14:15:33.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cd029700 1 -- 172.21.15.5:0/1302731967 reap_dead start 2023-08-09T14:15:33.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 shutdown_connections 2023-08-09T14:15:33.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 >> 172.21.15.5:0/1302731967 conn(0x7fa6c80b1900 msgr2=0x7fa6c80b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 shutdown_connections 2023-08-09T14:15:33.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.371+0000 7fa6cea8c700 1 -- 172.21.15.5:0/1302731967 wait complete. 2023-08-09T14:15:33.425 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-08-09T14:15:33.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:15:33.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-09T14:15:33.426 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-08-09T14:15:33.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-09T14:15:33.427 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2023-08-09T14:15:33.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-09T14:15:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.381+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 --> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92080c6e60 con 0x7f91ec072920 2023-08-09T14:15:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f91fdffb700 1 -- 172.21.15.5:0/1145369309 <== osd.7 v2:172.21.15.101:6819/483537661 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92080c6e60 con 0x7f91ec072920 2023-08-09T14:15:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] conn(0x7f91ec072920 msgr2=0x7f91ec074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6819/483537661,v1:172.21.15.101:6821/483537661] conn(0x7f91ec072920 0x7f91ec074d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f91ec06a0e0 msgr2=0x7f91ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f91ec06a0e0 0x7f91ec06c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009130 tx=0x7f91f8008030 comp rx=0 tx=0).stop 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9208161950 msgr2=0x7f9208152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 --2- 172.21.15.5:0/1145369309 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9208161950 0x7f9208152630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f920000bb00 tx=0x7f920000be10 comp rx=0 tx=0).stop 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920dc55700 1 -- 172.21.15.5:0/1145369309 reap_dead start 2023-08-09T14:15:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 shutdown_connections 2023-08-09T14:15:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 >> 172.21.15.5:0/1145369309 conn(0x7f92080cfb10 msgr2=0x7f92080b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.382+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 shutdown_connections 2023-08-09T14:15:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.383+0000 7f920f6b8700 1 -- 172.21.15.5:0/1145369309 wait complete. 2023-08-09T14:15:33.431 INFO:teuthology.orchestra.run.smithi005.stdout:60129542152 2023-08-09T14:15:33.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-09T14:15:33.432 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-08-09T14:15:33.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-09T14:15:33.468 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:15:33.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.678+0000 7f110d064700 1 Processor -- start 2023-08-09T14:15:33.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.678+0000 7f6984dc0700 1 Processor -- start 2023-08-09T14:15:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.679+0000 7f110d064700 1 -- start start 2023-08-09T14:15:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.679+0000 7f7946681700 1 Processor -- start 2023-08-09T14:15:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.679+0000 7f7946681700 1 -- start start 2023-08-09T14:15:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.680+0000 7f110d064700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f11080ce140 0x7f110816c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.680+0000 7f110d064700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110806b270 con 0x7f1108161860 2023-08-09T14:15:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.680+0000 7f110d064700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11081660d0 con 0x7f11080cbb20 2023-08-09T14:15:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.680+0000 7f110d064700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1108161c40 con 0x7f11080ce140 2023-08-09T14:15:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.680+0000 7f6984dc0700 1 -- start start 2023-08-09T14:15:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f7946681700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79400cbed0 0x7f79400c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f7946681700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400c9c50 con 0x7f7940159990 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f7946681700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794015d360 con 0x7f79400c92b0 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f7946681700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940150900 con 0x7f79400cbed0 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f793ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7940159990 0x7f79400cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56180/0 (socket says 172.21.15.5:56180) 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f793ffff700 1 -- 172.21.15.5:0/4056749528 learned_addr learned my addr 172.21.15.5:0/4056749528 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832881144 0 0) 0x7f79400c9c50 con 0x7f7940159990 2023-08-09T14:15:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79280046c0 con 0x7f7940159990 2023-08-09T14:15:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f6984dc0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6980161cc0 0x7f69800cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f6984dc0700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f698006a8d0 0x7f69801652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f6984dc0700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69800cf790 con 0x7f69801618e0 2023-08-09T14:15:33.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f6984dc0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800cfc20 con 0x7f6980161cc0 2023-08-09T14:15:33.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f6984dc0700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800cf460 con 0x7f698006a8d0 2023-08-09T14:15:33.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f1106d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1108161860 0x7f11081652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56186/0 (socket says 172.21.15.5:56186) 2023-08-09T14:15:33.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.681+0000 7f1106d9d700 1 -- 172.21.15.5:0/2862713143 learned_addr learned my addr 172.21.15.5:0/2862713143 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566184705 0 0) 0x7f110806b270 con 0x7f1108161860 2023-08-09T14:15:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f00035b0 con 0x7f1108161860 2023-08-09T14:15:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f697e59c700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f69801618e0 0x7f698006a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37534/0 (socket says 172.21.15.5:37534) 2023-08-09T14:15:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f697e59c700 1 -- 172.21.15.5:0/3243840766 learned_addr learned my addr 172.21.15.5:0/3243840766 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f697ed9d700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f698006a8d0 0x7f69801652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372722272 0 0) 0x7f10f00035b0 con 0x7f1108161860 2023-08-09T14:15:33.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 >> v2:172.21.15.101:3300/0 conn(0x7f11080ce140 msgr2=0x7f110816c5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 --2- 172.21.15.5:0/2862713143 >> v2:172.21.15.101:3300/0 conn(0x7f11080ce140 0x7f110816c5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 >> v1:172.21.15.101:6789/0 conn(0x7f11080cbb20 legacy=0x7f11081659c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080c2b00 con 0x7f1108161860 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f10fc001670 con 0x7f1108161860 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 >> v1:172.21.15.5:6789/0 conn(0x7f1108161860 legacy=0x7f11081652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10f0003a00 0x7f10f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f10f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10f0005330 0x7f10f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108161c40 con 0x7f10f0004850 2023-08-09T14:15:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000c230 con 0x7f10f0003a00 2023-08-09T14:15:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000c3f0 con 0x7f10f0005330 2023-08-09T14:15:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076646408 0 0) 0x7f79280046c0 con 0x7f7940159990 2023-08-09T14:15:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79400cbed0 msgr2=0x7f79400c9710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79400cbed0 0x7f79400c9710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 >> v1:172.21.15.101:6789/0 conn(0x7f79400c92b0 legacy=0x7f79400cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794015d640 con 0x7f7940159990 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f7934001200 con 0x7f7940159990 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 >> v1:172.21.15.5:6789/0 conn(0x7f7940159990 legacy=0x7f79400cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f7928004b40 0x7f7928004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7928005960 0x7f7928005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7928006370 0x7f792800cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940150900 con 0x7f7928006370 2023-08-09T14:15:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280037c0 con 0x7f7928005960 2023-08-09T14:15:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.682+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7928003980 con 0x7f7928004b40 2023-08-09T14:15:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f1106d9d700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10f0003a00 0x7f10f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 --2- 172.21.15.5:0/3243840766 >> v2:172.21.15.5:3300/0 conn(0x7f6980161cc0 0x7f69800cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f7928004b40 0x7f7928004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 -- 172.21.15.5:0/3243840766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f698006a8d0 msgr2=0x7f69801652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f698006a8d0 0x7f69801652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 -- 172.21.15.5:0/3243840766 >> v1:172.21.15.101:6789/0 conn(0x7f69801618e0 legacy=0x7f698006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 -- 172.21.15.5:0/3243840766 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980071f10 con 0x7f6980161cc0 2023-08-09T14:15:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 -- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7928005960 msgr2=0x7f7928005de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7928005960 0x7f7928005de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 -- 172.21.15.5:0/4056749528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7928006370 msgr2=0x7f792800cb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7928006370 0x7f792800cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 -- 172.21.15.5:0/4056749528 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794015d640 con 0x7f7928004b40 2023-08-09T14:15:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697dd9b700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6980161cc0 0x7f69800cd190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6968009840 tx=0x7f6968009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cc590346a04ab1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697d59a700 1 -- 172.21.15.5:0/3243840766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011830 con 0x7f6980161cc0 2023-08-09T14:15:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697d59a700 1 -- 172.21.15.5:0/3243840766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968011990 con 0x7f6980161cc0 2023-08-09T14:15:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f697d59a700 1 -- 172.21.15.5:0/3243840766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011d00 con 0x7f6980161cc0 2023-08-09T14:15:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.683+0000 7f793ffff700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f7928004b40 0x7f7928004f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f793400c2c0 tx=0x7f7928006990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270c0dbaf4835468 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110759e700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10f0005330 0x7f10f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f10f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 -- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10f0005330 msgr2=0x7f10f000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10f0005330 0x7f10f000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 -- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10f0003a00 msgr2=0x7f10f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10f0003a00 0x7f10f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110659c700 1 -- 172.21.15.5:0/2862713143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00035b0 con 0x7f10f0004850 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110759e700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10f0005330 0x7f10f000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f110759e700 1 -- 172.21.15.5:0/2862713143 reap_dead start 2023-08-09T14:15:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f6984dc0700 1 -- 172.21.15.5:0/3243840766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6980161cc0 msgr2=0x7f69800cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.684+0000 7f6984dc0700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6980161cc0 0x7f69800cd190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6968009840 tx=0x7f6968009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f110659c700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f10f0004cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009850 tx=0x7f10f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4917f80fe4df3633 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80092f0 con 0x7f10f0004850 2023-08-09T14:15:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8011620 con 0x7f10f0004850 2023-08-09T14:15:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f1105d9b700 1 -- 172.21.15.5:0/2862713143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80119b0 con 0x7f10f0004850 2023-08-09T14:15:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f6984dc0700 1 -- 172.21.15.5:0/3243840766 shutdown_connections 2023-08-09T14:15:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f6984dc0700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f698006a8d0 0x7f69801652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f6984dc0700 1 --2- 172.21.15.5:0/3243840766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6980161cc0 0x7f69800cd190 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6968009840 tx=0x7f6968009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f6984dc0700 1 -- 172.21.15.5:0/3243840766 >> 172.21.15.5:0/3243840766 conn(0x7f69800b1900 msgr2=0x7f69800b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400ce60 con 0x7f7928004b40 2023-08-09T14:15:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340070d0 con 0x7f7928004b40 2023-08-09T14:15:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f793effd700 1 -- 172.21.15.5:0/4056749528 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934007460 con 0x7f7928004b40 2023-08-09T14:15:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f7946681700 1 -- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f7928004b40 msgr2=0x7f7928004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.685+0000 7f7946681700 1 --2- 172.21.15.5:0/4056749528 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f7928004b40 0x7f7928004f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f793400c2c0 tx=0x7f7928006990 comp rx=0 tx=0).stop 2023-08-09T14:15:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f735f307700 1 Processor -- start 2023-08-09T14:15:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7fe84a66e700 1 Processor -- start 2023-08-09T14:15:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f7944c1e700 1 -- 172.21.15.5:0/4056749528 reap_dead start 2023-08-09T14:15:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f6984dc0700 1 -- 172.21.15.5:0/3243840766 shutdown_connections 2023-08-09T14:15:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7fe84a66e700 1 -- start start 2023-08-09T14:15:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f6984dc0700 1 -- 172.21.15.5:0/3243840766 wait complete. 2023-08-09T14:15:33.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f110d064700 1 -- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 msgr2=0x7f10f0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f110d064700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f10f0004cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009850 tx=0x7f10f0005880 comp rx=0 tx=0).stop 2023-08-09T14:15:33.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f110d064700 1 -- 172.21.15.5:0/2862713143 shutdown_connections 2023-08-09T14:15:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f110d064700 1 --2- 172.21.15.5:0/2862713143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f10f0004cd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f110d064700 1 -- 172.21.15.5:0/2862713143 >> 172.21.15.5:0/2862713143 conn(0x7f11080cf560 msgr2=0x7f11080cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f7946681700 1 -- 172.21.15.5:0/4056749528 shutdown_connections 2023-08-09T14:15:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.686+0000 7f7946681700 1 -- 172.21.15.5:0/4056749528 >> 172.21.15.5:0/4056749528 conn(0x7f79400b0850 msgr2=0x7f79400b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7f735f307700 1 -- start start 2023-08-09T14:15:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8440c92b0 0x7fe8440c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe844150900 con 0x7fe8440c92b0 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84415dee0 con 0x7fe844159990 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe84a66e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c9c50 con 0x7fe8440cb7c0 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe843fff700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe843fff700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59830/0 (socket says 172.21.15.5:59830) 2023-08-09T14:15:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.687+0000 7fe843fff700 1 -- 172.21.15.5:0/1671324135 learned_addr learned my addr 172.21.15.5:0/1671324135 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe848c0b700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f7946681700 1 -- 172.21.15.5:0/4056749528 shutdown_connections 2023-08-09T14:15:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1671324135 >> v2:172.21.15.5:3300/0 conn(0x7fe8440c92b0 0x7fe8440c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f6984dc0700 1 Processor -- start 2023-08-09T14:15:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f110d064700 1 -- 172.21.15.5:0/2862713143 shutdown_connections 2023-08-09T14:15:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 -- 172.21.15.5:0/1671324135 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 msgr2=0x7fe8440cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 -- 172.21.15.5:0/1671324135 >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 msgr2=0x7fe8440cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1671324135 >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 -- 172.21.15.5:0/1671324135 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440ccd70 con 0x7fe8440c92b0 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe843fff700 1 --2- 172.21.15.5:0/1671324135 >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8440c92b0 0x7fe8440c9710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe844068890 tx=0x7fe838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67a04f3efd1b705 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f7946681700 1 -- 172.21.15.5:0/4056749528 wait complete. 2023-08-09T14:15:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f7946681700 1 Processor -- start 2023-08-09T14:15:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f7946681700 1 -- start start 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f6984dc0700 1 -- start start 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698006a8d0 0x7f69800c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 0x7f69801550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 0x7f69801facd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800b4950 con 0x7f698006a8d0 2023-08-09T14:15:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800b4040 con 0x7f69801618e0 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f6984dc0700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800b4300 con 0x7f6980155630 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f697dd9b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 0x7f69801550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697ed9d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 0x7f69801facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697ed9d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 0x7f69801facd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60616/0 (socket says 172.21.15.5:60616) 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697ed9d700 1 -- 172.21.15.5:0/243928414 learned_addr learned my addr 172.21.15.5:0/243928414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697e59c700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698006a8d0 0x7f69800c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735f307700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f7358161950 0x7f73580d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735f307700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735f307700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580b1530 con 0x7f73580b5050 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735f307700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7358161d30 con 0x7f7358161950 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735f307700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b0f00 con 0x7f73580b10d0 2023-08-09T14:15:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735d0a3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f7358161950 0x7f73580d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735d0a3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f7358161950 0x7f73580d2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59838/0 (socket says 172.21.15.5:59838) 2023-08-09T14:15:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735d0a3700 1 -- 172.21.15.5:0/4007392878 learned_addr learned my addr 172.21.15.5:0/4007392878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.688+0000 7f735c8a2700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f735d0a3700 1 -- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 msgr2=0x7f73580b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f735d0a3700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f735d0a3700 1 -- 172.21.15.5:0/4007392878 >> v1:172.21.15.5:6789/0 conn(0x7f73580b5050 legacy=0x7f73581653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f735d0a3700 1 -- 172.21.15.5:0/4007392878 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580afe60 con 0x7f7358161950 2023-08-09T14:15:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f735d0a3700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7358161950 0x7f73580d2b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73480098f0 tx=0x7f7348009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c13f63034c10e82 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7f110d064700 1 -- 172.21.15.5:0/2862713143 wait complete. 2023-08-09T14:15:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7fe842ffd700 1 -- 172.21.15.5:0/1671324135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838011830 con 0x7fe8440c92b0 2023-08-09T14:15:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7fe842ffd700 1 -- 172.21.15.5:0/1671324135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838011990 con 0x7fe8440c92b0 2023-08-09T14:15:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.689+0000 7fe842ffd700 1 -- 172.21.15.5:0/1671324135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838011d20 con 0x7fe8440c92b0 2023-08-09T14:15:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7fe84a66e700 1 -- 172.21.15.5:0/1671324135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8440c92b0 msgr2=0x7fe8440c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8440c92b0 0x7fe8440c9710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe844068890 tx=0x7fe838009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697dd9b700 1 -- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 msgr2=0x7f69801facd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697dd9b700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 0x7f69801facd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697dd9b700 1 -- 172.21.15.5:0/243928414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698006a8d0 msgr2=0x7f69800c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697dd9b700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698006a8d0 0x7f69800c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f697dd9b700 1 -- 172.21.15.5:0/243928414 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680094a0 con 0x7f69801618e0 2023-08-09T14:15:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f734ffff700 1 -- 172.21.15.5:0/4007392878 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348004230 con 0x7f7358161950 2023-08-09T14:15:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.690+0000 7f734ffff700 1 -- 172.21.15.5:0/4007392878 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348004390 con 0x7f7358161950 2023-08-09T14:15:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f697dd9b700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 0x7f69801550f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6968016000 tx=0x7f6968004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f734ffff700 1 -- 172.21.15.5:0/4007392878 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480036a0 con 0x7f7358161950 2023-08-09T14:15:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 0x7f79400c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 0x7f79400b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79400c71f0 0x7f79400b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400c83d0 con 0x7f79400c8860 2023-08-09T14:15:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400c77c0 con 0x7f79400c71f0 2023-08-09T14:15:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f7946681700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400c7aa0 con 0x7f79401ee780 2023-08-09T14:15:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 -- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7358161950 msgr2=0x7f73580d2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7358161950 0x7f73580d2b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73480098f0 tx=0x7f7348009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 -- 172.21.15.5:0/4007392878 shutdown_connections 2023-08-09T14:15:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f7358161950 0x7f73580d2b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 --2- 172.21.15.5:0/4007392878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 -- 172.21.15.5:0/4007392878 >> 172.21.15.5:0/4007392878 conn(0x7f73580cfb10 msgr2=0x7f73580cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f110d064700 1 Processor -- start 2023-08-09T14:15:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968004450 con 0x7f69801618e0 2023-08-09T14:15:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69680045b0 con 0x7f69801618e0 2023-08-09T14:15:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680038e0 con 0x7f69801618e0 2023-08-09T14:15:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 -- 172.21.15.5:0/4007392878 shutdown_connections 2023-08-09T14:15:33.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f793ffff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 0x7f79400c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f793ffff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 0x7f79400c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60620/0 (socket says 172.21.15.5:60620) 2023-08-09T14:15:33.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f793ffff700 1 -- 172.21.15.5:0/2414085995 learned_addr learned my addr 172.21.15.5:0/2414085995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f793f7fe700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 0x7f79400b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f7944c1e700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79400c71f0 0x7f79400b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f793f7fe700 1 -- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 msgr2=0x7f79400c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f793f7fe700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 0x7f79400c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f793f7fe700 1 -- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79400c71f0 msgr2=0x7f79400b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f793f7fe700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79400c71f0 0x7f79400b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f793f7fe700 1 -- 172.21.15.5:0/2414085995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400c7d80 con 0x7f79400c8860 2023-08-09T14:15:33.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 -- 172.21.15.5:0/1671324135 shutdown_connections 2023-08-09T14:15:33.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1671324135 >> v2:172.21.15.101:3300/0 conn(0x7fe844159990 0x7fe8440cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1671324135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8440c92b0 0x7fe8440c9710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 -- 172.21.15.5:0/1671324135 >> 172.21.15.5:0/1671324135 conn(0x7fe8440b0850 msgr2=0x7fe8440b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 -- 172.21.15.5:0/1671324135 shutdown_connections 2023-08-09T14:15:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f735f307700 1 -- 172.21.15.5:0/4007392878 wait complete. 2023-08-09T14:15:33.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.691+0000 7f110d064700 1 -- start start 2023-08-09T14:15:33.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f1108158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 0x7f11080b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108159040 con 0x7f10f0004850 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108162fe0 con 0x7f11080c3a90 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f110d064700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11080b3ed0 con 0x7f1108162620 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60624/0 (socket says 172.21.15.5:60624) 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 -- 172.21.15.5:0/408014854 learned_addr learned my addr 172.21.15.5:0/408014854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110659c700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 0x7f11080b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 -- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 msgr2=0x7f11080b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 0x7f11080b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 -- 172.21.15.5:0/408014854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 msgr2=0x7f1108158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f1108158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f735f307700 1 Processor -- start 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 -- 172.21.15.5:0/408014854 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080b41b0 con 0x7f1108162620 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110659c700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 0x7f11080b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f110759e700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11080ce590 tx=0x7f110000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000a890 con 0x7f1108162620 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000aa10 con 0x7f1108162620 2023-08-09T14:15:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000ae00 con 0x7f1108162620 2023-08-09T14:15:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7fe84a66e700 1 -- 172.21.15.5:0/1671324135 wait complete. 2023-08-09T14:15:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7fe84a66e700 1 Processor -- start 2023-08-09T14:15:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.692+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69800b45e0 con 0x7f69801618e0 2023-08-09T14:15:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800b4de0 con 0x7f69801618e0 2023-08-09T14:15:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f735f307700 1 -- start start 2023-08-09T14:15:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f735f307700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f735f307700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f735f307700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358161950 0x7f73580ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f735f307700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580d1e40 con 0x7f7358161950 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735f307700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73581645f0 con 0x7f73580b5050 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735f307700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73581ff320 con 0x7f73580b10d0 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735d0a3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59860/0 (socket says 172.21.15.5:59860) 2023-08-09T14:15:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 -- 172.21.15.5:0/1816241869 learned_addr learned my addr 172.21.15.5:0/1816241869 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11080b4490 con 0x7f1108162620 2023-08-09T14:15:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11080b4770 con 0x7f1108162620 2023-08-09T14:15:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1108074600 con 0x7f1108162620 2023-08-09T14:15:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 -- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 msgr2=0x7f73580c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 -- 172.21.15.5:0/1816241869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358161950 msgr2=0x7f73580ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358161950 0x7f73580ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 -- 172.21.15.5:0/1816241869 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348009550 con 0x7f73580b5050 2023-08-09T14:15:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.695+0000 7f735c8a2700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f735400e810 tx=0x7f735400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7fe84a66e700 1 -- start start 2023-08-09T14:15:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe844159990 0x7fe84415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414db20 con 0x7fe844159990 2023-08-09T14:15:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844071b80 con 0x7fe8440c92b0 2023-08-09T14:15:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe84a66e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440becd0 con 0x7fe8440cb7c0 2023-08-09T14:15:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354013610 con 0x7f73580b5050 2023-08-09T14:15:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354013770 con 0x7f73580b5050 2023-08-09T14:15:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73580d1b60 con 0x7f73580b5050 2023-08-09T14:15:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7358164280 con 0x7f73580b5050 2023-08-09T14:15:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354013b20 con 0x7f73580b5050 2023-08-09T14:15:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6968003a40 con 0x7f69801618e0 2023-08-09T14:15:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f6976ffd700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 0x7f696006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6968089990 con 0x7f69801618e0 2023-08-09T14:15:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe843fff700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe843fff700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59866/0 (socket says 172.21.15.5:59866) 2023-08-09T14:15:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe843fff700 1 -- 172.21.15.5:0/1643881647 learned_addr learned my addr 172.21.15.5:0/1643881647 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.697+0000 7f697e59c700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 0x7f696006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.697+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73380052f0 con 0x7f73580b5050 2023-08-09T14:15:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f110000d040 con 0x7f1108162620 2023-08-09T14:15:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69800b4770 con 0x7f69801618e0 2023-08-09T14:15:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 -- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 msgr2=0x7fe8440bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 -- 172.21.15.5:0/1643881647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe844159990 msgr2=0x7fe84415b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe844159990 0x7fe84415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 -- 172.21.15.5:0/1643881647 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380094a0 con 0x7fe8440c92b0 2023-08-09T14:15:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f793f7fe700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 0x7f79400b4e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f793800cb10 tx=0x7f793800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f10ef7fe700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 0x7f10f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7fe843fff700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe83400e810 tx=0x7fe83400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800aaa0 con 0x7f79400c8860 2023-08-09T14:15:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800ac00 con 0x7f79400c8860 2023-08-09T14:15:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400c8060 con 0x7f79400c8860 2023-08-09T14:15:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f4d5bb6c700 1 Processor -- start 2023-08-09T14:15:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.693+0000 7f4d5bb6c700 1 -- start start 2023-08-09T14:15:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f4d5bb6c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d54169de0 0x7f4d5406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f4d5bb6c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d540caf90 0x7f4d540ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f4d5bb6c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540b1600 con 0x7f4d5416a1c0 2023-08-09T14:15:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f4d5bb6c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540cb470 con 0x7f4d54169de0 2023-08-09T14:15:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.694+0000 7f4d5bb6c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540cb750 con 0x7f4d540caf90 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f4d5a109700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f4d5416a1c0 0x7f4d5408a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37588/0 (socket says 172.21.15.5:37588) 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f4d5a109700 1 -- 172.21.15.5:0/317225252 learned_addr learned my addr 172.21.15.5:0/317225252 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.696+0000 7f4d59107700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d540caf90 0x7f4d540ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f4d58906700 1 -- 172.21.15.5:0/317225252 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148976839 0 0) 0x7f4d540b1600 con 0x7f4d5416a1c0 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f4d59908700 1 --2- 172.21.15.5:0/317225252 >> v2:172.21.15.5:3300/0 conn(0x7f4d54169de0 0x7f4d5406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1100088b00 con 0x7f1108162620 2023-08-09T14:15:33.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f4d58906700 1 -- 172.21.15.5:0/317225252 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003590 con 0x7f4d5416a1c0 2023-08-09T14:15:33.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f1106d9d700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 0x7f10f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f4d59908700 1 -- 172.21.15.5:0/317225252 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d540caf90 msgr2=0x7f4d540ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f4d59908700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d540caf90 0x7f4d540ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f4d59908700 1 -- 172.21.15.5:0/317225252 >> v1:172.21.15.101:6789/0 conn(0x7f4d5416a1c0 legacy=0x7f4d5408a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f4d59908700 1 -- 172.21.15.5:0/317225252 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540cba30 con 0x7f4d54169de0 2023-08-09T14:15:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f697e59c700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 0x7f696006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69780012e0 tx=0x7f6978001a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f1106d9d700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 0x7f10f406c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000f60 tx=0x7f10fc000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.698+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79401eeb60 con 0x7f79400c8860 2023-08-09T14:15:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938012420 con 0x7f79400c8860 2023-08-09T14:15:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f4d59908700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54169de0 0x7f4d5406c650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c860 tx=0x7f4d4400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ada2329430d783a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f4d58906700 1 -- 172.21.15.5:0/317225252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011070 con 0x7f4d54169de0 2023-08-09T14:15:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f4d58906700 1 -- 172.21.15.5:0/317225252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44007770 con 0x7f4d54169de0 2023-08-09T14:15:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200052f0 con 0x7f79400c8860 2023-08-09T14:15:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.699+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7354013c80 con 0x7f73580b5050 2023-08-09T14:15:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f734dffb700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 0x7f733c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73540881d0 con 0x7f73580b5050 2023-08-09T14:15:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f735d0a3700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 0x7f733c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f4d58906700 1 -- 172.21.15.5:0/317225252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44007b00 con 0x7f4d54169de0 2023-08-09T14:15:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7938012580 con 0x7f79400c8860 2023-08-09T14:15:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.700+0000 7f735d0a3700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 0x7f733c06c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7348009130 tx=0x7f7348008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f793cff9700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 0x7f792c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/317225252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54169de0 msgr2=0x7f4d5406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54169de0 0x7f4d5406c650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c860 tx=0x7f4d4400cb70 comp rx=0 tx=0).stop 2023-08-09T14:15:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/317225252 shutdown_connections 2023-08-09T14:15:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54169de0 0x7f4d5406c650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/317225252 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d540caf90 0x7f4d540ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/317225252 >> 172.21.15.5:0/317225252 conn(0x7f4d540b0850 msgr2=0x7f4d540b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7938090350 con 0x7f79400c8860 2023-08-09T14:15:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/317225252 shutdown_connections 2023-08-09T14:15:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/317225252 wait complete. 2023-08-09T14:15:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.701+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f11000542d0 con 0x7f1108162620 2023-08-09T14:15:33.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.702+0000 7f793ffff700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 0x7f792c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.702+0000 7f4d5bb6c700 1 Processor -- start 2023-08-09T14:15:33.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.702+0000 7f4d5bb6c700 1 -- start start 2023-08-09T14:15:33.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7fd81c19c700 1 Processor -- start 2023-08-09T14:15:33.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540caf90 0x7f4d542047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 0x7f4d54203500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 0x7f4d540c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c3fa0 con 0x7f4d540caf90 2023-08-09T14:15:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5416adb0 con 0x7f4d54169de0 2023-08-09T14:15:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7f4d5bb6c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54204cf0 con 0x7f4d5416a1c0 2023-08-09T14:15:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834005c20 con 0x7fe8440c92b0 2023-08-09T14:15:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440bd1b0 con 0x7fe8440c92b0 2023-08-09T14:15:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84414dd90 con 0x7fe8440c92b0 2023-08-09T14:15:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7f4d5a109700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 0x7f4d540c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7f4d59107700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 0x7f4d54203500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7f4d5a109700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 0x7f4d540c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60658/0 (socket says 172.21.15.5:60658) 2023-08-09T14:15:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7f4d5a109700 1 -- 172.21.15.5:0/455757611 learned_addr learned my addr 172.21.15.5:0/455757611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.703+0000 7fd81c19c700 1 -- start start 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.704+0000 7fd81c19c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fd8140ce140 0x7fd81416c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81c19c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81406b270 con 0x7fd8140cbb20 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81c19c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8141660d0 con 0x7fd814161860 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81c19c700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd814161c40 con 0x7fd8140ce140 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fd8140ce140 0x7fd81416c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 -- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 msgr2=0x7f4d540c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 0x7f4d540c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 -- 172.21.15.5:0/455757611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540caf90 msgr2=0x7f4d542047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540caf90 0x7f4d542047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 -- 172.21.15.5:0/455757611 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44006120 con 0x7f4d54169de0 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fd8140ce140 0x7fd81416c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59894/0 (socket says 172.21.15.5:59894) 2023-08-09T14:15:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 -- 172.21.15.5:0/2478864908 learned_addr learned my addr 172.21.15.5:0/2478864908 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd819f38700 1 --1- 172.21.15.5:0/2478864908 >> v1:172.21.15.101:6789/0 conn(0x7fd814161860 0x7fd8141652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37610/0 (socket says 172.21.15.5:37610) 2023-08-09T14:15:33.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f4d59107700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 0x7f4d54203500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e900 tx=0x7f4d5000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 -- 172.21.15.5:0/2478864908 >> v1:172.21.15.101:6789/0 conn(0x7fd814161860 legacy=0x7fd8141652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 -- 172.21.15.5:0/2478864908 >> v1:172.21.15.5:6789/0 conn(0x7fd8140cbb20 legacy=0x7fd8141659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 -- 172.21.15.5:0/2478864908 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140c2b00 con 0x7fd8140ce140 2023-08-09T14:15:33.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7fd81a739700 1 --2- 172.21.15.5:0/2478864908 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140ce140 0x7fd81416c5e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009e50 tx=0x7fd80c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb7e82306f4096c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6968055070 con 0x7f69801618e0 2023-08-09T14:15:33.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.705+0000 7f793ffff700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 0x7f792c06c5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79340019c0 tx=0x7f7934007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.706+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8440beb30 con 0x7fe8440c92b0 2023-08-09T14:15:33.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834004030 con 0x7fe8440c92b0 2023-08-09T14:15:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400c020 con 0x7fe8440c92b0 2023-08-09T14:15:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000ee50 con 0x7f4d54169de0 2023-08-09T14:15:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000c850 con 0x7f4d54169de0 2023-08-09T14:15:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000cbc0 con 0x7f4d54169de0 2023-08-09T14:15:33.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.708+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f73540572c0 con 0x7f73580b5050 2023-08-09T14:15:33.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7fd818f36700 1 -- 172.21.15.5:0/2478864908 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00e070 con 0x7fd8140ce140 2023-08-09T14:15:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540c27f0 con 0x7f4d54169de0 2023-08-09T14:15:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7fd818f36700 1 -- 172.21.15.5:0/2478864908 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c003a20 con 0x7fd8140ce140 2023-08-09T14:15:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7fd818f36700 1 -- 172.21.15.5:0/2478864908 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c003dd0 con 0x7fd8140ce140 2023-08-09T14:15:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540c44b0 con 0x7f4d54169de0 2023-08-09T14:15:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.711+0000 7fd81c19c700 1 -- 172.21.15.5:0/2478864908 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140ce140 msgr2=0x7fd81416c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.711+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2478864908 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140ce140 0x7fd81416c5e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009e50 tx=0x7fd80c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.710+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe8340043a0 con 0x7fe8440c92b0 2023-08-09T14:15:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.711+0000 7fe840ff9700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 0x7fe82806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.711+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8340882b0 con 0x7fe8440c92b0 2023-08-09T14:15:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.711+0000 7f9902939700 1 Processor -- start 2023-08-09T14:15:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.712+0000 7f9902939700 1 -- start start 2023-08-09T14:15:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.712+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d54074600 con 0x7f4d54169de0 2023-08-09T14:15:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.709+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f793808d060 con 0x7f79400c8860 2023-08-09T14:15:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 0x7fe82806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98fc159cd0 0x7f98fc0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc06cd50 0x7f98fc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f98fc0cb7f0 0x7f98fc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0cc560 con 0x7f98fc159cd0 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc06d6f0 con 0x7f98fc0cb7f0 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9902939700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0ca3c0 con 0x7f98fc06cd50 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f98fbfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98fc159cd0 0x7f98fc0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f98fbfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98fc159cd0 0x7f98fc0ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42856/0 (socket says 172.21.15.5:42856) 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f98fbfff700 1 -- 172.21.15.5:0/197998756 learned_addr learned my addr 172.21.15.5:0/197998756 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f9900ed6700 1 --2- 172.21.15.5:0/197998756 >> v2:172.21.15.101:3300/0 conn(0x7f98fc0cb7f0 0x7f98fc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7fe8437fe700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 0x7fe82806c570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe838000c00 tx=0x7fe83801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe834053920 con 0x7fe8440c92b0 2023-08-09T14:15:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f98fbfff700 1 -- 172.21.15.5:0/197998756 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc06cd50 msgr2=0x7f98fc06d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-09T14:15:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.713+0000 7f98fbfff700 1 --2- 172.21.15.5:0/197998756 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc06cd50 0x7f98fc06d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98fbfff700 1 -- 172.21.15.5:0/197998756 >> v2:172.21.15.101:3300/0 conn(0x7f98fc0cb7f0 msgr2=0x7f98fc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98fbfff700 1 --2- 172.21.15.5:0/197998756 >> v2:172.21.15.101:3300/0 conn(0x7f98fc0cb7f0 0x7f98fc0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98fbfff700 1 -- 172.21.15.5:0/197998756 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0c9a90 con 0x7f98fc159cd0 2023-08-09T14:15:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98fbfff700 1 --2- 172.21.15.5:0/197998756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0ca850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0720c0 tx=0x7f98ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465b1324f12149d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98faffd700 1 -- 172.21.15.5:0/197998756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00f8a0 con 0x7f98fc159cd0 2023-08-09T14:15:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98faffd700 1 -- 172.21.15.5:0/197998756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00fa00 con 0x7f98fc159cd0 2023-08-09T14:15:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.714+0000 7f98faffd700 1 -- 172.21.15.5:0/197998756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00fd90 con 0x7f98fc159cd0 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7fd81c19c700 1 -- 172.21.15.5:0/2478864908 shutdown_connections 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2478864908 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140ce140 0x7fd81416c5e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7fd81c19c700 1 -- 172.21.15.5:0/2478864908 >> 172.21.15.5:0/2478864908 conn(0x7fd8140cf560 msgr2=0x7fd8140cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7fd81c19c700 1 -- 172.21.15.5:0/2478864908 shutdown_connections 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7fd81c19c700 1 -- 172.21.15.5:0/2478864908 wait complete. 2023-08-09T14:15:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.716+0000 7fd81c19c700 1 Processor -- start 2023-08-09T14:15:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 -- start start 2023-08-09T14:15:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140cbb20 0x7fd8140b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd814161860 0x7fd814155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b2320 con 0x7fd8140ce140 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b1940 con 0x7fd8140cbb20 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81c19c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b1660 con 0x7fd814161860 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd819737700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd819737700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42866/0 (socket says 172.21.15.5:42866) 2023-08-09T14:15:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd819737700 1 -- 172.21.15.5:0/2096138944 learned_addr learned my addr 172.21.15.5:0/2096138944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.717+0000 7fd81a739700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd814161860 0x7fd814155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 -- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd814161860 msgr2=0x7fd814155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd814161860 0x7fd814155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 -- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140cbb20 msgr2=0x7fd8140b0e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140cbb20 0x7fd8140b0e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 -- 172.21.15.5:0/2096138944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c009b30 con 0x7fd8140ce140 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd819737700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c4a0 tx=0x7fd80400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040054e0 con 0x7fd8140ce140 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140b25c0 con 0x7fd8140ce140 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8140b1350 con 0x7fd8140ce140 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804003680 con 0x7fd8140ce140 2023-08-09T14:15:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.719+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804003a30 con 0x7fd8140ce140 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.720+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc0052f0 con 0x7fd8140ce140 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.721+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd804003b90 con 0x7fd8140ce140 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.721+0000 7fd80a7fc700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 0x7fd7f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.721+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd804087a00 con 0x7fd8140ce140 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d5000cd20 con 0x7f4d54169de0 2023-08-09T14:15:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7f4d4a7fc700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 0x7f4d3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d50088d30 con 0x7f4d54169de0 2023-08-09T14:15:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.716+0000 7f4d59908700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 0x7f4d3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.716+0000 7f4d59908700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 0x7f4d3806c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400cbb0 tx=0x7f4d44011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.718+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4d50057eb0 con 0x7f4d54169de0 2023-08-09T14:15:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7f9902939700 1 -- 172.21.15.5:0/197998756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 msgr2=0x7f98fc0ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.715+0000 7f9902939700 1 --2- 172.21.15.5:0/197998756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0ca850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0720c0 tx=0x7f98ec009bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.728+0000 7fd819f38700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 0x7fd7f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.728+0000 7fd819f38700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 0x7fd7f806c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd810001550 tx=0x7fd810007a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.730+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd8040530f0 con 0x7fd8140ce140 2023-08-09T14:15:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 -- 172.21.15.5:0/197998756 shutdown_connections 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 --2- 172.21.15.5:0/197998756 >> v2:172.21.15.101:3300/0 conn(0x7f98fc0cb7f0 0x7f98fc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 --2- 172.21.15.5:0/197998756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0ca850 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 --2- 172.21.15.5:0/197998756 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc06cd50 0x7f98fc06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 -- 172.21.15.5:0/197998756 >> 172.21.15.5:0/197998756 conn(0x7f98fc0b0850 msgr2=0x7f98fc0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 -- 172.21.15.5:0/197998756 shutdown_connections 2023-08-09T14:15:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.734+0000 7f9902939700 1 -- 172.21.15.5:0/197998756 wait complete. 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.736+0000 7f9902939700 1 Processor -- start 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.737+0000 7f9902939700 1 -- start start 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98fc06cd50 0x7f98fc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc0cb7f0 0x7f98fc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc150030 con 0x7f98fc159cd0 2023-08-09T14:15:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc150310 con 0x7f98fc06cd50 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9902939700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1505f0 con 0x7f98fc0cb7f0 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.738+0000 7f9900ed6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42874/0 (socket says 172.21.15.5:42874) 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 -- 172.21.15.5:0/3290714862 learned_addr learned my addr 172.21.15.5:0/3290714862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 -- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc0cb7f0 msgr2=0x7f98fc0afbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc0cb7f0 0x7f98fc0afbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 -- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98fc06cd50 msgr2=0x7f98fc0c75a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98fc06cd50 0x7f98fc0c75a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 -- 172.21.15.5:0/3290714862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec009550 con 0x7f98fc159cd0 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.739+0000 7f9900ed6700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98f400efc0 tx=0x7f98f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.743+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f400cd40 con 0x7f98fc159cd0 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.743+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f400f040 con 0x7f98fc159cd0 2023-08-09T14:15:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.743+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40146a0 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.743+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc1508d0 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.743+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc150e90 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.747+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98f4014800 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.748+0000 7f98f8ff9700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 0x7f98e808e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.748+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98f4088ec0 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.749+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc0052f0 con 0x7f98fc159cd0 2023-08-09T14:15:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.753+0000 7f98fbfff700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 0x7f98e808e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.759+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f98f4018080 con 0x7f98fc159cd0 2023-08-09T14:15:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:33.783+0000 7f98fbfff700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 0x7f98e808e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009c10 tx=0x7f98ec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:34.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.112+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7920005870 con 0x7f79400c8860 2023-08-09T14:15:34.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.113+0000 7f793cff9700 1 -- 172.21.15.5:0/2414085995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7938016020 con 0x7f79400c8860 2023-08-09T14:15:34.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.113+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1108066090 con 0x7f1108162620 2023-08-09T14:15:34.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.115+0000 7f10ef7fe700 1 -- 172.21.15.5:0/408014854 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f110000e360 con 0x7f1108162620 2023-08-09T14:15:34.118 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-08-09T14:15:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.119+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 msgr2=0x7f10f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.119+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 0x7f10f406c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000f60 tx=0x7f10fc000ed0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.119+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 msgr2=0x7f1108162aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.119+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11080ce590 tx=0x7f110000cef0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 shutdown_connections 2023-08-09T14:15:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10f406a0e0 0x7f10f406c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1108162620 0x7f1108162aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f0004850 0x7f1108158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 --2- 172.21.15.5:0/408014854 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f11080c3a90 0x7f11080b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.120+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 >> 172.21.15.5:0/408014854 conn(0x7f11080cf560 msgr2=0x7f1108071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.125 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-08-09T14:15:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.122+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f73380055a0 con 0x7f73580b5050 2023-08-09T14:15:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 msgr2=0x7f792c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 0x7f792c06c5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79340019c0 tx=0x7f7934007000 comp rx=0 tx=0).stop 2023-08-09T14:15:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 msgr2=0x7f79400b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 0x7f79400b4e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f793800cb10 tx=0x7f793800ce20 comp rx=0 tx=0).stop 2023-08-09T14:15:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 shutdown_connections 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f792c06a130 0x7f792c06c5f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79400c71f0 0x7f79400b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79401ee780 0x7f79400c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 --2- 172.21.15.5:0/2414085995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79400c8860 0x7f79400b4e40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 >> 172.21.15.5:0/2414085995 conn(0x7f79400b0850 msgr2=0x7f79400ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 shutdown_connections 2023-08-09T14:15:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.123+0000 7f7946681700 1 -- 172.21.15.5:0/2414085995 wait complete. 2023-08-09T14:15:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.124+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69800b4ac0 con 0x7f69801618e0 2023-08-09T14:15:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.128+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 shutdown_connections 2023-08-09T14:15:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.128+0000 7f110d064700 1 -- 172.21.15.5:0/408014854 wait complete. 2023-08-09T14:15:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.128+0000 7f6976ffd700 1 -- 172.21.15.5:0/243928414 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f696802b030 con 0x7f69801618e0 2023-08-09T14:15:34.131 INFO:teuthology.orchestra.run.smithi005.stdout:55834574851 2023-08-09T14:15:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.130+0000 7f734dffb700 1 -- 172.21.15.5:0/1816241869 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7354056e50 con 0x7f73580b5050 2023-08-09T14:15:34.133 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2023-08-09T14:15:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.132+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 msgr2=0x7f696006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.132+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 0x7f696006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69780012e0 tx=0x7f6978001a30 comp rx=0 tx=0).stop 2023-08-09T14:15:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.132+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 msgr2=0x7f69801550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.132+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 0x7f69801550f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6968016000 tx=0x7f6968004750 comp rx=0 tx=0).stop 2023-08-09T14:15:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe8440beb30 con 0x7fe8440c92b0 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 msgr2=0x7f733c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 0x7f733c06c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7348009130 tx=0x7f7348008030 comp rx=0 tx=0).stop 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 msgr2=0x7f73581fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f735400e810 tx=0x7f735400eb20 comp rx=0 tx=0).stop 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 shutdown_connections 2023-08-09T14:15:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f733c06a0e0 0x7f733c06c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358161950 0x7f73580ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f73580b10d0 0x7f73580c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 --2- 172.21.15.5:0/1816241869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f73580b5050 0x7f73581fede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 >> 172.21.15.5:0/1816241869 conn(0x7f73580cfb10 msgr2=0x7f73580cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.133+0000 7fe840ff9700 1 -- 172.21.15.5:0/1643881647 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8440beb30 con 0x7fe8440c92b0 2023-08-09T14:15:34.138 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2023-08-09T14:15:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 msgr2=0x7fe82806c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 0x7fe82806c570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe838000c00 tx=0x7fe83801c040 comp rx=0 tx=0).stop 2023-08-09T14:15:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 msgr2=0x7fe8441584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe83400e810 tx=0x7fe83400eb20 comp rx=0 tx=0).stop 2023-08-09T14:15:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 shutdown_connections 2023-08-09T14:15:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe82806a0b0 0x7fe82806c570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe844159990 0x7fe84415b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe8440c92b0 0x7fe8441584d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 --2- 172.21.15.5:0/1643881647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe8440cb7c0 0x7fe8440bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 >> 172.21.15.5:0/1643881647 conn(0x7fe8440b0850 msgr2=0x7fe8440c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 shutdown_connections 2023-08-09T14:15:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f696006a0e0 0x7f696006c5a0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69780012e0 tx=0x7f6978001a30 comp rx=0 tx=0).stop 2023-08-09T14:15:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6980155630 0x7f69801facd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698006a8d0 0x7f69800c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 --2- 172.21.15.5:0/243928414 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69801618e0 0x7f69801550f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 >> 172.21.15.5:0/243928414 conn(0x7f69800b1900 msgr2=0x7f69800b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.137+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 shutdown_connections 2023-08-09T14:15:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.138+0000 7f735f307700 1 -- 172.21.15.5:0/1816241869 wait complete. 2023-08-09T14:15:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.141+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 shutdown_connections 2023-08-09T14:15:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.141+0000 7fe84a66e700 1 -- 172.21.15.5:0/1643881647 wait complete. 2023-08-09T14:15:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.141+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 shutdown_connections 2023-08-09T14:15:34.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-08-09T14:15:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.144+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4d540cc5c0 con 0x7f4d54169de0 2023-08-09T14:15:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.147+0000 7f4d4a7fc700 1 -- 172.21.15.5:0/455757611 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d50017090 con 0x7f4d54169de0 2023-08-09T14:15:34.149 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2023-08-09T14:15:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.149+0000 7f6984dc0700 1 -- 172.21.15.5:0/243928414 wait complete. 2023-08-09T14:15:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.150+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 msgr2=0x7f4d3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.150+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 0x7f4d3806c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400cbb0 tx=0x7f4d44011000 comp rx=0 tx=0).stop 2023-08-09T14:15:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.150+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 msgr2=0x7f4d54203500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.150+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 0x7f4d54203500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e900 tx=0x7f4d5000ec10 comp rx=0 tx=0).stop 2023-08-09T14:15:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.151+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd7fc005870 con 0x7fd8140ce140 2023-08-09T14:15:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 shutdown_connections 2023-08-09T14:15:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4d3806a0e0 0x7f4d3806c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4d5416a1c0 0x7f4d540c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540caf90 0x7f4d542047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 --2- 172.21.15.5:0/455757611 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4d54169de0 0x7f4d54203500 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 >> 172.21.15.5:0/455757611 conn(0x7f4d540b0850 msgr2=0x7f4d540cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 shutdown_connections 2023-08-09T14:15:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7f4d5bb6c700 1 -- 172.21.15.5:0/455757611 wait complete. 2023-08-09T14:15:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.152+0000 7fd80a7fc700 1 -- 172.21.15.5:0/2096138944 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd804017090 con 0x7fd8140ce140 2023-08-09T14:15:34.158 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-08-09T14:15:34.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-08-09T14:15:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 msgr2=0x7fd7f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 0x7fd7f806c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd810001550 tx=0x7fd810007a50 comp rx=0 tx=0).stop 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 msgr2=0x7fd8140b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c4a0 tx=0x7fd80400c7b0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 shutdown_connections 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd7f806a0e0 0x7fd7f806c5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd814161860 0x7fd814155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd8140cbb20 0x7fd8140b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 --2- 172.21.15.5:0/2096138944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140ce140 0x7fd8140b4800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 >> 172.21.15.5:0/2096138944 conn(0x7fd8140cf560 msgr2=0x7fd8141648b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 shutdown_connections 2023-08-09T14:15:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.156+0000 7fd81c19c700 1 -- 172.21.15.5:0/2096138944 wait complete. 2023-08-09T14:15:34.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2023-08-09T14:15:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.161+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f98dc0055a0 con 0x7f98fc159cd0 2023-08-09T14:15:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.161+0000 7f98f8ff9700 1 -- 172.21.15.5:0/3290714862 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98f4058020 con 0x7f98fc159cd0 2023-08-09T14:15:34.164 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-08-09T14:15:34.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 msgr2=0x7f98e808e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 0x7f98e808e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009c10 tx=0x7f98ec008030 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 msgr2=0x7f98fc0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98f400efc0 tx=0x7f98f400c3a0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 shutdown_connections 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98e808c1c0 0x7f98e808e680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98fc159cd0 0x7f98fc0b0130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98fc06cd50 0x7f98fc0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 --2- 172.21.15.5:0/3290714862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98fc0cb7f0 0x7f98fc0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 >> 172.21.15.5:0/3290714862 conn(0x7f98fc0b0850 msgr2=0x7f98fc070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 shutdown_connections 2023-08-09T14:15:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:34.164+0000 7f9902939700 1 -- 172.21.15.5:0/3290714862 wait complete. 2023-08-09T14:15:34.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2023-08-09T14:15:34.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2023-08-09T14:15:34.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-08-09T14:15:34.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2023-08-09T14:15:34.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-08-09T14:15:35.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-09T14:15:35.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-09T14:15:35.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-09T14:15:35.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-09T14:15:35.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-09T14:15:35.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-09T14:15:35.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-09T14:15:35.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-09T14:15:35.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.350+0000 7f1019d4b700 1 Processor -- start 2023-08-09T14:15:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.350+0000 7f1019d4b700 1 -- start start 2023-08-09T14:15:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.351+0000 7f1019d4b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1014159990 0x7f10140cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.351+0000 7f1019d4b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140cbed0 0x7f10140c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.351+0000 7f1019d4b700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140c9c50 con 0x7f10140c92b0 2023-08-09T14:15:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.351+0000 7f1019d4b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1014150900 con 0x7f1014159990 2023-08-09T14:15:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.351+0000 7f1019d4b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101415dee0 con 0x7f10140cbed0 2023-08-09T14:15:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.353+0000 7f1013fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140cbed0 0x7f10140c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.353+0000 7f10137fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1014159990 0x7f10140cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.353+0000 7f10137fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1014159990 0x7f10140cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42880/0 (socket says 172.21.15.5:42880) 2023-08-09T14:15:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.353+0000 7f10137fe700 1 -- 172.21.15.5:0/2182950219 learned_addr learned my addr 172.21.15.5:0/2182950219 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.354+0000 7f10137fe700 1 -- 172.21.15.5:0/2182950219 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140cbed0 msgr2=0x7f10140c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.354+0000 7f10137fe700 1 --2- 172.21.15.5:0/2182950219 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140cbed0 0x7f10140c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.354+0000 7f10137fe700 1 -- 172.21.15.5:0/2182950219 >> v1:172.21.15.101:6789/0 conn(0x7f10140c92b0 legacy=0x7f10140cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.354+0000 7f10137fe700 1 -- 172.21.15.5:0/2182950219 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140ccd70 con 0x7f1014159990 2023-08-09T14:15:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.354+0000 7f10137fe700 1 --2- 172.21.15.5:0/2182950219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f10140cc830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c360 tx=0x7f100c00c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905e9260a0401106 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.355+0000 7f10127fc700 1 -- 172.21.15.5:0/2182950219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00f070 con 0x7f1014159990 2023-08-09T14:15:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.355+0000 7f10127fc700 1 -- 172.21.15.5:0/2182950219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00ce80 con 0x7f1014159990 2023-08-09T14:15:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.355+0000 7f10127fc700 1 -- 172.21.15.5:0/2182950219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c003c20 con 0x7f1014159990 2023-08-09T14:15:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.356+0000 7f1019d4b700 1 -- 172.21.15.5:0/2182950219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 msgr2=0x7f10140cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.356+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2182950219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f10140cc830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c360 tx=0x7f100c00c670 comp rx=0 tx=0).stop 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 -- 172.21.15.5:0/2182950219 shutdown_connections 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2182950219 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140cbed0 0x7f10140c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2182950219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f10140cc830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 -- 172.21.15.5:0/2182950219 >> 172.21.15.5:0/2182950219 conn(0x7f10140b0850 msgr2=0x7f10140b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 -- 172.21.15.5:0/2182950219 shutdown_connections 2023-08-09T14:15:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.357+0000 7f1019d4b700 1 -- 172.21.15.5:0/2182950219 wait complete. 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.359+0000 7f1019d4b700 1 Processor -- start 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.359+0000 7f1019d4b700 1 -- start start 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.360+0000 7f1019d4b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 0x7f10141ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.361+0000 7f1019d4b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 0x7f1014151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.361+0000 7f1019d4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f1014153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.361+0000 7f1019d4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014151f90 con 0x7f1014159990 2023-08-09T14:15:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.361+0000 7f1019d4b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014156940 con 0x7f10140cbed0 2023-08-09T14:15:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.361+0000 7f1019d4b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1014150a40 con 0x7f10140c92b0 2023-08-09T14:15:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 0x7f1014151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 0x7f1014151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59932/0 (socket says 172.21.15.5:59932) 2023-08-09T14:15:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f1012ffd700 1 -- 172.21.15.5:0/2639544118 learned_addr learned my addr 172.21.15.5:0/2639544118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 0x7f10141ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 -- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 msgr2=0x7f1014151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 0x7f1014151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 -- 172.21.15.5:0/2639544118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 msgr2=0x7f1014153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f1014153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.362+0000 7f10137fe700 1 -- 172.21.15.5:0/2639544118 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c00c050 con 0x7f10140c92b0 2023-08-09T14:15:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.363+0000 7f10137fe700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 0x7f10141ef260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f100c014000 tx=0x7f100c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.368+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c004300 con 0x7f10140c92b0 2023-08-09T14:15:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.368+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c004480 con 0x7f10140c92b0 2023-08-09T14:15:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.368+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c004830 con 0x7f10140c92b0 2023-08-09T14:15:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.368+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10141538a0 con 0x7f10140c92b0 2023-08-09T14:15:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.368+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1014150f70 con 0x7f10140c92b0 2023-08-09T14:15:35.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.380+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f100c01e430 con 0x7f10140c92b0 2023-08-09T14:15:35.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.381+0000 7f1003fff700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 0x7f0ffc06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.381+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f100c08a140 con 0x7f10140c92b0 2023-08-09T14:15:35.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.381+0000 7f1012ffd700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 0x7f0ffc06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.382+0000 7f1012ffd700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 0x7f0ffc06c7d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10140c53e0 tx=0x7f1008009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.386+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff00052f0 con 0x7f10140c92b0 2023-08-09T14:15:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.399+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f100c0558a0 con 0x7f10140c92b0 2023-08-09T14:15:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.416+0000 7fe7a7bd6700 1 Processor -- start 2023-08-09T14:15:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.416+0000 7fe7a7bd6700 1 -- start start 2023-08-09T14:15:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7a00b1340 0x7fe7a00cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 0x7fe7a006c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a0150900 con 0x7fe7a00b1340 2023-08-09T14:15:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a015dee0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.417+0000 7fe7a7bd6700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00ccd70 con 0x7fe7a00cb7c0 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7a00b1340 0x7fe7a00cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7a00b1340 0x7fe7a00cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42896/0 (socket says 172.21.15.5:42896) 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 -- 172.21.15.5:0/4019038666 learned_addr learned my addr 172.21.15.5:0/4019038666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a6173700 1 --2- 172.21.15.5:0/4019038666 >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 0x7fe7a006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5171700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 -- 172.21.15.5:0/4019038666 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 msgr2=0x7fe7a00cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 -- 172.21.15.5:0/4019038666 >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 msgr2=0x7fe7a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 --2- 172.21.15.5:0/4019038666 >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 0x7fe7a006c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a5972700 1 -- 172.21.15.5:0/4019038666 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a015d360 con 0x7fe7a00b1340 2023-08-09T14:15:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.418+0000 7fe7a6173700 1 --2- 172.21.15.5:0/4019038666 >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 0x7fe7a006c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.419+0000 7fe7a5972700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a00b1340 0x7fe7a00cc830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00cc720 tx=0x7fe79c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7055bfd359f4691c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.419+0000 7fe7a4970700 1 -- 172.21.15.5:0/4019038666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005e30 con 0x7fe7a00b1340 2023-08-09T14:15:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.419+0000 7fe7a4970700 1 -- 172.21.15.5:0/4019038666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c014a20 con 0x7fe7a00b1340 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.419+0000 7fe7a4970700 1 -- 172.21.15.5:0/4019038666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c014dd0 con 0x7fe7a00b1340 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/4019038666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a00b1340 msgr2=0x7fe7a00cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a00b1340 0x7fe7a00cc830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00cc720 tx=0x7fe79c009bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/4019038666 shutdown_connections 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/4019038666 >> v2:172.21.15.101:3300/0 conn(0x7fe7a006bfe0 0x7fe7a006c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a00b1340 0x7fe7a00cc830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/4019038666 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/4019038666 >> 172.21.15.5:0/4019038666 conn(0x7fe7a00b0850 msgr2=0x7fe7a00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/4019038666 shutdown_connections 2023-08-09T14:15:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.420+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/4019038666 wait complete. 2023-08-09T14:15:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.422+0000 7fe7a7bd6700 1 Processor -- start 2023-08-09T14:15:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.422+0000 7fe7a7bd6700 1 -- start start 2023-08-09T14:15:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.422+0000 7fe7a7bd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.422+0000 7fe7a7bd6700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe7a00b1340 0x7fe7a00ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a7bd6700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a7bd6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00c4e60 con 0x7fe7a006bfe0 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a7bd6700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00c6670 con 0x7fe7a00b1340 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a7bd6700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00c6950 con 0x7fe7a00cb7c0 2023-08-09T14:15:35.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42900/0 (socket says 172.21.15.5:42900) 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 -- 172.21.15.5:0/3920377411 learned_addr learned my addr 172.21.15.5:0/3920377411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a6173700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5171700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe7a00b1340 0x7fe7a00ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 -- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 msgr2=0x7fe7a00aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 -- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe7a00b1340 msgr2=0x7fe7a00ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe7a00b1340 0x7fe7a00ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 -- 172.21.15.5:0/3920377411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009a70 con 0x7fe7a006bfe0 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.423+0000 7fe7a5972700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe79c004000 tx=0x7fe79c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.424+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0039b0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.424+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c003b10 con 0x7fe7a006bfe0 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.424+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c009500 con 0x7fe7a006bfe0 2023-08-09T14:15:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.424+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c024420 con 0x7fe7a006bfe0 2023-08-09T14:15:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.424+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a00c6f10 con 0x7fe7a006bfe0 2023-08-09T14:15:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.425+0000 7f080f121700 1 Processor -- start 2023-08-09T14:15:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f5eddda7700 1 Processor -- start 2023-08-09T14:15:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.425+0000 7f080f121700 1 -- start start 2023-08-09T14:15:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0808159990 0x7f08080cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08080c92b0 0x7f08080c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 0x7f08080cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0808150900 con 0x7f08080c92b0 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080c9c70 con 0x7f08080cb7c0 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f080f121700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080815dee0 con 0x7f0808159990 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f080d6be700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 0x7f08080cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f080cebd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0808159990 0x7f08080cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f080d6be700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 0x7f08080cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59954/0 (socket says 172.21.15.5:59954) 2023-08-09T14:15:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f080d6be700 1 -- 172.21.15.5:0/1003955083 learned_addr learned my addr 172.21.15.5:0/1003955083 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 --2- 172.21.15.5:0/1003955083 >> v2:172.21.15.5:3300/0 conn(0x7f08080c92b0 0x7f08080c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 -- 172.21.15.5:0/1003955083 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0808159990 msgr2=0x7f08080cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 --2- 172.21.15.5:0/1003955083 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0808159990 0x7f08080cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 -- 172.21.15.5:0/1003955083 >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 msgr2=0x7f08080cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 --2- 172.21.15.5:0/1003955083 >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 0x7f08080cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 -- 172.21.15.5:0/1003955083 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080ccd70 con 0x7f08080c92b0 2023-08-09T14:15:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0807fff700 1 --2- 172.21.15.5:0/1003955083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080c92b0 0x7f08080c9730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f080813fba0 tx=0x7f07fc013430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986765f7f713c98f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0d46742700 1 Processor -- start 2023-08-09T14:15:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f0d46742700 1 -- start start 2023-08-09T14:15:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe79c024580 con 0x7fe7a006bfe0 2023-08-09T14:15:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7fe7967fc700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 0x7fe78406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe79c0919d0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7fe7a5171700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 0x7fe78406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a015dbe0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f3c29454700 1 Processor -- start 2023-08-09T14:15:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.426+0000 7f3c29454700 1 -- start start 2023-08-09T14:15:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f3c29454700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f3c240caf90 0x7f3c240ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f3c29454700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240b1600 con 0x7f3c2416a1c0 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f3c29454700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240cb470 con 0x7f3c24169de0 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.427+0000 7f3c29454700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240cb750 con 0x7f3c240caf90 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c22ffd700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f3c24169de0 0x7f3c2406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37676/0 (socket says 172.21.15.5:37676) 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c22ffd700 1 -- 172.21.15.5:0/4249762706 learned_addr learned my addr 172.21.15.5:0/4249762706 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c227fc700 1 --2- 172.21.15.5:0/4249762706 >> v2:172.21.15.101:3300/0 conn(0x7f3c240caf90 0x7f3c240ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f0d46742700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d4015b360 0x7f0d40154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f0d46742700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 0x7f0d400ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f0d46742700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d400cee00 con 0x7f0d4015b790 2023-08-09T14:15:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f0d46742700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40154b40 con 0x7f0d4015b360 2023-08-09T14:15:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f0d46742700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4015eb20 con 0x7f0d400ce410 2023-08-09T14:15:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f08077fe700 1 -- 172.21.15.5:0/1003955083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc016070 con 0x7f08080c92b0 2023-08-09T14:15:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f5eddda7700 1 -- start start 2023-08-09T14:15:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5eddda7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ed80cb590 0x7f5ed80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5eddda7700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5eddda7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed80cd880 con 0x7f5ed815b1e0 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5eddda7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed80b3420 con 0x7f5ed80cb590 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5eddda7700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80d1e50 con 0x7f5ed80b2f90 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60744/0 (socket says 172.21.15.5:60744) 2023-08-09T14:15:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f5ed7fff700 1 -- 172.21.15.5:0/2803769976 learned_addr learned my addr 172.21.15.5:0/2803769976 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7fe7a5171700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 0x7fe78406c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00afbf0 tx=0x7fe790008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed7fff700 1 -- 172.21.15.5:0/2803769976 >> v2:172.21.15.5:3300/0 conn(0x7f5ed80cb590 msgr2=0x7f5ed80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed7fff700 1 --2- 172.21.15.5:0/2803769976 >> v2:172.21.15.5:3300/0 conn(0x7f5ed80cb590 0x7f5ed80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed7fff700 1 -- 172.21.15.5:0/2803769976 >> v1:172.21.15.5:6789/0 conn(0x7f5ed815b1e0 legacy=0x7f5ed80cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed7fff700 1 -- 172.21.15.5:0/2803769976 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed806f7e0 con 0x7f5ed80b2f90 2023-08-09T14:15:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f08077fe700 1 -- 172.21.15.5:0/1003955083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc013ce0 con 0x7f08080c92b0 2023-08-09T14:15:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f08077fe700 1 -- 172.21.15.5:0/1003955083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0112d0 con 0x7f08080c92b0 2023-08-09T14:15:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f080f121700 1 -- 172.21.15.5:0/1003955083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080c92b0 msgr2=0x7f08080c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f080f121700 1 --2- 172.21.15.5:0/1003955083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080c92b0 0x7f08080c9730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f080813fba0 tx=0x7f07fc013430 comp rx=0 tx=0).stop 2023-08-09T14:15:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed7fff700 1 --2- 172.21.15.5:0/2803769976 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae09aca94229238f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f0d44cdf700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 0x7f0d400ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f0d44cdf700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 0x7f0d400ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:59966/0 (socket says 172.21.15.5:59966) 2023-08-09T14:15:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f0d44cdf700 1 -- 172.21.15.5:0/1571833065 learned_addr learned my addr 172.21.15.5:0/1571833065 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed67fc700 1 -- 172.21.15.5:0/2803769976 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000e070 con 0x7f5ed80b2f90 2023-08-09T14:15:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed67fc700 1 -- 172.21.15.5:0/2803769976 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0003a20 con 0x7f5ed80b2f90 2023-08-09T14:15:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f5ed67fc700 1 -- 172.21.15.5:0/2803769976 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0003dd0 con 0x7f5ed80b2f90 2023-08-09T14:15:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 --2- 172.21.15.5:0/1571833065 >> v2:172.21.15.5:3300/0 conn(0x7f0d4015b360 0x7f0d40154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 -- 172.21.15.5:0/1571833065 >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 msgr2=0x7f0d400ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 --2- 172.21.15.5:0/1571833065 >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 0x7f0d400ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 -- 172.21.15.5:0/1571833065 >> v1:172.21.15.101:6789/0 conn(0x7f0d4015b790 legacy=0x7f0d4015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 -- 172.21.15.5:0/1571833065 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4015e2d0 con 0x7f0d4015b360 2023-08-09T14:15:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f0d3ffff700 1 --2- 172.21.15.5:0/1571833065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d40154600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d400ca7e0 tx=0x7f0d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55ff0c425f33f9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 -- 172.21.15.5:0/2803769976 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 msgr2=0x7f5ed815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 --2- 172.21.15.5:0/2803769976 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 -- 172.21.15.5:0/2803769976 shutdown_connections 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 --2- 172.21.15.5:0/2803769976 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80b2f90 0x7f5ed815b5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 --2- 172.21.15.5:0/2803769976 >> v2:172.21.15.5:3300/0 conn(0x7f5ed80cb590 0x7f5ed80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 -- 172.21.15.5:0/2803769976 >> 172.21.15.5:0/2803769976 conn(0x7f5ed80d0fd0 msgr2=0x7f5ed80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f5eddda7700 1 -- 172.21.15.5:0/2803769976 shutdown_connections 2023-08-09T14:15:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.432+0000 7f5eddda7700 1 -- 172.21.15.5:0/2803769976 wait complete. 2023-08-09T14:15:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c21ffb700 1 -- 172.21.15.5:0/4249762706 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280896646 0 0) 0x7f3c240b1600 con 0x7f3c2416a1c0 2023-08-09T14:15:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c227fc700 1 -- 172.21.15.5:0/4249762706 >> v1:172.21.15.101:6789/0 conn(0x7f3c24169de0 legacy=0x7f3c2406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c227fc700 1 -- 172.21.15.5:0/4249762706 >> v1:172.21.15.5:6789/0 conn(0x7f3c2416a1c0 legacy=0x7f3c2408a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c227fc700 1 -- 172.21.15.5:0/4249762706 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240cba30 con 0x7f3c240caf90 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.428+0000 7f3c227fc700 1 --2- 172.21.15.5:0/4249762706 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c240caf90 0x7f3c240ce0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800dc60 tx=0x7f3c1800df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd38e61a70357628 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f3c21ffb700 1 -- 172.21.15.5:0/4249762706 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18012070 con 0x7f3c240caf90 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f3c21ffb700 1 -- 172.21.15.5:0/4249762706 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800d2e0 con 0x7f3c240caf90 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.429+0000 7f3c21ffb700 1 -- 172.21.15.5:0/4249762706 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18004250 con 0x7f3c240caf90 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f3c29454700 1 -- 172.21.15.5:0/4249762706 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c240caf90 msgr2=0x7f3c240ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.430+0000 7f3c29454700 1 --2- 172.21.15.5:0/4249762706 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c240caf90 0x7f3c240ce0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800dc60 tx=0x7f3c1800df70 comp rx=0 tx=0).stop 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f3c29454700 1 -- 172.21.15.5:0/4249762706 shutdown_connections 2023-08-09T14:15:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f3c29454700 1 --2- 172.21.15.5:0/4249762706 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c240caf90 0x7f3c240ce0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.431+0000 7f3c29454700 1 -- 172.21.15.5:0/4249762706 >> 172.21.15.5:0/4249762706 conn(0x7f3c240b0850 msgr2=0x7f3c240b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f3c29454700 1 -- 172.21.15.5:0/4249762706 shutdown_connections 2023-08-09T14:15:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 -- 172.21.15.5:0/1003955083 shutdown_connections 2023-08-09T14:15:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 --2- 172.21.15.5:0/1003955083 >> v2:172.21.15.101:3300/0 conn(0x7f08080cb7c0 0x7f08080cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 --2- 172.21.15.5:0/1003955083 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0808159990 0x7f08080cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 --2- 172.21.15.5:0/1003955083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080c92b0 0x7f08080c9730 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f080813fba0 tx=0x7f07fc013430 comp rx=0 tx=0).stop 2023-08-09T14:15:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 -- 172.21.15.5:0/1003955083 >> 172.21.15.5:0/1003955083 conn(0x7f08080b0850 msgr2=0x7f08080b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f3c29454700 1 -- 172.21.15.5:0/4249762706 wait complete. 2023-08-09T14:15:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 -- 172.21.15.5:0/1003955083 shutdown_connections 2023-08-09T14:15:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f5eddda7700 1 Processor -- start 2023-08-09T14:15:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.434+0000 7f3c29454700 1 Processor -- start 2023-08-09T14:15:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.433+0000 7f080f121700 1 -- 172.21.15.5:0/1003955083 wait complete. 2023-08-09T14:15:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f080f121700 1 Processor -- start 2023-08-09T14:15:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.434+0000 7f5eddda7700 1 -- start start 2023-08-09T14:15:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80cb590 0x7f5ed81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ed815b1e0 0x7f5ed80b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed815b6f0 con 0x7f5ed80b2f90 2023-08-09T14:15:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81f7560 con 0x7f5ed815b1e0 2023-08-09T14:15:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5eddda7700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81f7840 con 0x7f5ed80cb590 2023-08-09T14:15:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5ed77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5ed77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42932/0 (socket says 172.21.15.5:42932) 2023-08-09T14:15:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f5ed77fe700 1 -- 172.21.15.5:0/3837560417 learned_addr learned my addr 172.21.15.5:0/3837560417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.434+0000 7f3c29454700 1 -- start start 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 0x7f3c24165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c2416a1c0 0x7f3c240c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24089250 con 0x7f3c2420bac0 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24160a00 con 0x7f3c2416a1c0 2023-08-09T14:15:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f3c29454700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24162520 con 0x7f3c240caf90 2023-08-09T14:15:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42938/0 (socket says 172.21.15.5:42938) 2023-08-09T14:15:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c237fe700 1 -- 172.21.15.5:0/1400808750 learned_addr learned my addr 172.21.15.5:0/1400808750 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c227fc700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c2416a1c0 0x7f3c240c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 0x7f3c24165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 -- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80cb590 msgr2=0x7f5ed81555b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80cb590 0x7f5ed81555b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 -- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ed815b1e0 msgr2=0x7f5ed80b14f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-09T14:15:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ed815b1e0 0x7f5ed80b14f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 -- 172.21.15.5:0/3837560417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009b30 con 0x7f5ed80b2f90 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 -- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c2416a1c0 msgr2=0x7f3c240c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c2416a1c0 0x7f3c240c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 -- 172.21.15.5:0/1400808750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 msgr2=0x7f3c2420bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 -- 172.21.15.5:0/1400808750 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1800d940 con 0x7f3c240caf90 2023-08-09T14:15:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c237fe700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f5ed77fe700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b470 tx=0x7f5ecc00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f3c22ffd700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 0x7f3c24165a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406b4e0 tx=0x7f3c1400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f0d3effd700 1 -- 172.21.15.5:0/1571833065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800e070 con 0x7f0d4015b360 2023-08-09T14:15:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f0d3effd700 1 -- 172.21.15.5:0/1571833065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800bae0 con 0x7f0d4015b360 2023-08-09T14:15:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f0d3effd700 1 -- 172.21.15.5:0/1571833065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800be70 con 0x7f0d4015b360 2023-08-09T14:15:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14005b60 con 0x7f3c240caf90 2023-08-09T14:15:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.435+0000 7f080f121700 1 -- start start 2023-08-09T14:15:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 0x7f080814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 0x7f08081555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080c4560 con 0x7f08080cb7c0 2023-08-09T14:15:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14005cc0 con 0x7f3c240caf90 2023-08-09T14:15:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c24162d30 con 0x7f3c240caf90 2023-08-09T14:15:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080c4840 con 0x7f0808159990 2023-08-09T14:15:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.436+0000 7f080f121700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080c4b20 con 0x7f08080c40d0 2023-08-09T14:15:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:60758/0 (socket says 172.21.15.5:60758) 2023-08-09T14:15:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 -- 172.21.15.5:0/914665682 learned_addr learned my addr 172.21.15.5:0/914665682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe7a015dbe0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f0807fff700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 0x7f08081555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 -- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 msgr2=0x7f08081555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080cebd700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 0x7f080814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 0x7f08081555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 -- 172.21.15.5:0/914665682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 msgr2=0x7f080814d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 0x7f080814d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080d6be700 1 -- 172.21.15.5:0/914665682 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc011d40 con 0x7f08080c40d0 2023-08-09T14:15:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f0807fff700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 0x7f08081555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f080cebd700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 0x7f080814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f080d6be700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f080000a890 tx=0x7f080000aba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011830 con 0x7f5ed80b2f90 2023-08-09T14:15:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc011990 con 0x7f5ed80b2f90 2023-08-09T14:15:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011d20 con 0x7f5ed80b2f90 2023-08-09T14:15:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed81f7b20 con 0x7f5ed80b2f90 2023-08-09T14:15:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed8159a80 con 0x7f5ed80b2f90 2023-08-09T14:15:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24162770 con 0x7f3c240caf90 2023-08-09T14:15:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.437+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14007310 con 0x7f3c240caf90 2023-08-09T14:15:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000cd10 con 0x7f08080c40d0 2023-08-09T14:15:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800008b10 con 0x7f08080c40d0 2023-08-09T14:15:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800008ea0 con 0x7f08080c40d0 2023-08-09T14:15:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f0d46742700 1 -- 172.21.15.5:0/1571833065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 msgr2=0x7f0d40154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.438+0000 7f0d46742700 1 --2- 172.21.15.5:0/1571833065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d40154600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d400ca7e0 tx=0x7f0d3800b330 comp rx=0 tx=0).stop 2023-08-09T14:15:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08080c4e00 con 0x7f08080c40d0 2023-08-09T14:15:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c040052f0 con 0x7f3c240caf90 2023-08-09T14:15:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f0d46742700 1 -- 172.21.15.5:0/1571833065 shutdown_connections 2023-08-09T14:15:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f0d46742700 1 --2- 172.21.15.5:0/1571833065 >> v2:172.21.15.101:3300/0 conn(0x7f0d400ce410 0x7f0d400ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f0d46742700 1 --2- 172.21.15.5:0/1571833065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d40154600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f0d46742700 1 -- 172.21.15.5:0/1571833065 >> 172.21.15.5:0/1571833065 conn(0x7f0d400b1900 msgr2=0x7f0d400b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ecc01a400 con 0x7f5ed80b2f90 2023-08-09T14:15:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c14007470 con 0x7f3c240caf90 2023-08-09T14:15:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f3c0b7fe700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 0x7f3c1006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c14087880 con 0x7f3c240caf90 2023-08-09T14:15:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f3c227fc700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 0x7f3c1006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080814def0 con 0x7f08080c40d0 2023-08-09T14:15:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb80052f0 con 0x7f5ed80b2f90 2023-08-09T14:15:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.440+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08080c5320 con 0x7f08080c40d0 2023-08-09T14:15:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7f3c227fc700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 0x7f3c1006c670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800dc60 tx=0x7f3c1800d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7f0d46742700 1 -- 172.21.15.5:0/1571833065 shutdown_connections 2023-08-09T14:15:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7f0d46742700 1 -- 172.21.15.5:0/1571833065 wait complete. 2023-08-09T14:15:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7f5ebffff700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 0x7f5ec406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ecc0884c0 con 0x7f5ed80b2f90 2023-08-09T14:15:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7f5ed6ffd700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 0x7f5ec406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7fbc6561e700 1 Processor -- start 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.439+0000 7fbc6561e700 1 -- start start 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc6561e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fbc60169de0 0x7fbc6006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc6561e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600b1600 con 0x7fbc600caf90 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc6561e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600cb470 con 0x7fbc600ce7d0 2023-08-09T14:15:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc6561e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600cb750 con 0x7fbc60169de0 2023-08-09T14:15:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc5f7fe700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7fbc600ce7d0 0x7fbc6008a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37720/0 (socket says 172.21.15.5:37720) 2023-08-09T14:15:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.441+0000 7fbc5f7fe700 1 -- 172.21.15.5:0/1733070346 learned_addr learned my addr 172.21.15.5:0/1733070346 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281423385 0 0) 0x7fbc600cb470 con 0x7fbc600ce7d0 2023-08-09T14:15:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc480035b0 con 0x7fbc600ce7d0 2023-08-09T14:15:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7f064f328700 1 Processor -- start 2023-08-09T14:15:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v1:172.21.15.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944051996 0 0) 0x7fbc480035b0 con 0x7fbc600ce7d0 2023-08-09T14:15:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 >> v2:172.21.15.101:3300/0 conn(0x7fbc60169de0 msgr2=0x7fbc6006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 --2- 172.21.15.5:0/1733070346 >> v2:172.21.15.101:3300/0 conn(0x7fbc60169de0 0x7fbc6006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 >> v1:172.21.15.5:6789/0 conn(0x7fbc600caf90 legacy=0x7fbc600ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 --> v1:172.21.15.101:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600cba30 con 0x7fbc600ce7d0 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v1:172.21.15.101:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fbc58001790 con 0x7fbc600ce7d0 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 >> v1:172.21.15.101:6789/0 conn(0x7fbc600ce7d0 legacy=0x7fbc6008a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc48003bd0 0x7fbc48005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc480067e0 0x7fbc48008c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 0x7fbc480099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600cb750 con 0x7fbc480067e0 2023-08-09T14:15:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800a2a0 con 0x7fbc48009510 2023-08-09T14:15:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800a460 con 0x7fbc48003bd0 2023-08-09T14:15:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 0x7fbc480099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7f0d46742700 1 Processor -- start 2023-08-09T14:15:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 -- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc48003bd0 msgr2=0x7fbc48005fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T14:15:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc48003bd0 0x7fbc48005fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 -- 172.21.15.5:0/1733070346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc480067e0 msgr2=0x7fbc48008c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc480067e0 0x7fbc48008c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 -- 172.21.15.5:0/1733070346 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600cba30 con 0x7fbc48009510 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 -- 172.21.15.5:0/1733070346 reap_dead start 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 0x7fbc480099c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d720 tx=0x7fbc48003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=426f402ba20019d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58016070 con 0x7fbc48009510 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800f4c0 con 0x7fbc48009510 2023-08-09T14:15:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7fbc5dffb700 1 -- 172.21.15.5:0/1733070346 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58007070 con 0x7fbc48009510 2023-08-09T14:15:35.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.442+0000 7f064f328700 1 -- start start 2023-08-09T14:15:35.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7f064f328700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0648159990 0x7f06480cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7f064f328700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480ccd70 con 0x7f06480cbed0 2023-08-09T14:15:35.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7f064f328700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064815d360 con 0x7f06480c92b0 2023-08-09T14:15:35.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7f064f328700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0648150900 con 0x7f0648159990 2023-08-09T14:15:35.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f064d0c4700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0648159990 0x7f06480cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.443+0000 7f0d46742700 1 -- start start 2023-08-09T14:15:35.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0d400ce410 0x7f0d40156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d4006de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40155190 con 0x7f0d4015b360 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40155470 con 0x7f0d4015b790 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d46742700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40155750 con 0x7f0d400ce410 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60016/0 (socket says 172.21.15.5:60016) 2023-08-09T14:15:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 -- 172.21.15.5:0/2394124091 learned_addr learned my addr 172.21.15.5:0/2394124091 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 -- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 msgr2=0x7fbc480099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 0x7fbc480099c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d720 tx=0x7fbc48003860 comp rx=0 tx=0).stop 2023-08-09T14:15:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 -- 172.21.15.5:0/1733070346 shutdown_connections 2023-08-09T14:15:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1733070346 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc48009510 0x7fbc480099c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 -- 172.21.15.5:0/1733070346 >> 172.21.15.5:0/1733070346 conn(0x7fbc600b0850 msgr2=0x7fbc600b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 -- 172.21.15.5:0/1733070346 shutdown_connections 2023-08-09T14:15:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7fbc6561e700 1 -- 172.21.15.5:0/1733070346 wait complete. 2023-08-09T14:15:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 -- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0d400ce410 msgr2=0x7f0d40156440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-09T14:15:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0d400ce410 0x7f0d40156440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 -- 172.21.15.5:0/2394124091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 msgr2=0x7f0d4006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d4006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f0d44cdf700 1 -- 172.21.15.5:0/2394124091 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38009a70 con 0x7f0d4015b790 2023-08-09T14:15:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.444+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3c14052f50 con 0x7f3c240caf90 2023-08-09T14:15:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.445+0000 7f5ed6ffd700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 0x7f5ec406c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ed815db50 tx=0x7f5ec8006cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.445+0000 7f064d8c5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06480cbed0 0x7f0648159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56382/0 (socket says 172.21.15.5:56382) 2023-08-09T14:15:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.445+0000 7f064d8c5700 1 -- 172.21.15.5:0/1138751476 learned_addr learned my addr 172.21.15.5:0/1138751476 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.446+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0800021440 con 0x7f08080c40d0 2023-08-09T14:15:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.446+0000 7fbc6561e700 1 Processor -- start 2023-08-09T14:15:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.446+0000 7f08057fa700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 0x7f07ec06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0800011070 con 0x7f08080c40d0 2023-08-09T14:15:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7f080cebd700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 0x7f07ec06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.446+0000 7fbc6561e700 1 -- start start 2023-08-09T14:15:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc600b3b10 0x7fbc6016d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 0x7fbc600c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b4820 con 0x7fbc48009510 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600c4fb0 con 0x7fbc600b3b10 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc6561e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6016d660 con 0x7fbc600c45f0 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc5effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc5effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42976/0 (socket says 172.21.15.5:42976) 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc5effd700 1 -- 172.21.15.5:0/1952431472 learned_addr learned my addr 172.21.15.5:0/1952431472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.447+0000 7fbc5e7fc700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc600b3b10 0x7fbc6016d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 0x7fbc600c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 -- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 msgr2=0x7fbc600c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 0x7fbc600c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 -- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc600b3b10 msgr2=0x7fbc6016d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc600b3b10 0x7fbc6016d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 -- 172.21.15.5:0/1952431472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600b3f90 con 0x7fbc48009510 2023-08-09T14:15:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7f080cebd700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 0x7f07ec06c670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07f4008de0 tx=0x7f07f4008390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5f7fe700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 0x7fbc600c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc5effd700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000b3a0 tx=0x7fbc5000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50005aa0 con 0x7fbc48009510 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50005c00 con 0x7fbc48009510 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50006020 con 0x7fbc48009510 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.448+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600b4260 con 0x7fbc48009510 2023-08-09T14:15:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.449+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6016a360 con 0x7fbc48009510 2023-08-09T14:15:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.449+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0800054710 con 0x7f08080c40d0 2023-08-09T14:15:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.450+0000 7f064d0c4700 1 -- 172.21.15.5:0/1138751476 >> v1:172.21.15.101:6789/0 conn(0x7f06480c92b0 legacy=0x7f06480cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.450+0000 7f064d0c4700 1 -- 172.21.15.5:0/1138751476 >> v1:172.21.15.5:6789/0 conn(0x7f06480cbed0 legacy=0x7f0648159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.450+0000 7f064d0c4700 1 -- 172.21.15.5:0/1138751476 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064815d640 con 0x7f0648159990 2023-08-09T14:15:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.450+0000 7f064d0c4700 1 --2- 172.21.15.5:0/1138751476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0648159990 0x7f06480cc830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06440090e0 tx=0x7f06440093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295d1c301a57639a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.450+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6016a1c0 con 0x7fbc48009510 2023-08-09T14:15:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7f063ffff700 1 -- 172.21.15.5:0/1138751476 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644005e30 con 0x7f0648159990 2023-08-09T14:15:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7f063ffff700 1 -- 172.21.15.5:0/1138751476 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644006030 con 0x7f0648159990 2023-08-09T14:15:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7f063ffff700 1 -- 172.21.15.5:0/1138751476 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440063e0 con 0x7f0648159990 2023-08-09T14:15:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbc50006180 con 0x7fbc48009510 2023-08-09T14:15:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.452+0000 7fbc477fe700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 0x7fbc4c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.452+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc50087d50 con 0x7fbc48009510 2023-08-09T14:15:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.452+0000 7fbc5e7fc700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 0x7fbc4c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7f064f328700 1 -- 172.21.15.5:0/1138751476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0648159990 msgr2=0x7f06480cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.451+0000 7f064f328700 1 --2- 172.21.15.5:0/1138751476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0648159990 0x7f06480cc830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06440090e0 tx=0x7f06440093f0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.452+0000 7fbc5e7fc700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 0x7fbc4c06c620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc600cd9d0 tx=0x7fbc54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5ecc053c80 con 0x7f5ed80b2f90 2023-08-09T14:15:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f0d44cdf700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000e900 tx=0x7f0d3000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f064f328700 1 -- 172.21.15.5:0/1138751476 shutdown_connections 2023-08-09T14:15:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f064f328700 1 --2- 172.21.15.5:0/1138751476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0648159990 0x7f06480cc830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f064f328700 1 -- 172.21.15.5:0/1138751476 >> 172.21.15.5:0/1138751476 conn(0x7f06480b0850 msgr2=0x7f06480b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f064f328700 1 -- 172.21.15.5:0/1138751476 shutdown_connections 2023-08-09T14:15:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.457+0000 7f064f328700 1 -- 172.21.15.5:0/1138751476 wait complete. 2023-08-09T14:15:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.461+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbc6016a1c0 con 0x7fbc48009510 2023-08-09T14:15:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.462+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300096e0 con 0x7f0d4015b790 2023-08-09T14:15:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.462+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000c850 con 0x7f0d4015b790 2023-08-09T14:15:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.462+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000cc00 con 0x7f0d4015b790 2023-08-09T14:15:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.463+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d40155a30 con 0x7f0d4015b790 2023-08-09T14:15:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.463+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4006e360 con 0x7f0d4015b790 2023-08-09T14:15:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.465+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d30013470 con 0x7f0d4015b790 2023-08-09T14:15:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.465+0000 7f0d3cff9700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 0x7f0d2c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.466+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d300885c0 con 0x7f0d4015b790 2023-08-09T14:15:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.466+0000 7f0d3ffff700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 0x7f0d2c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.466+0000 7f0d3ffff700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 0x7f0d2c06c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d400ca7e0 tx=0x7f0d38011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.458+0000 7f064f328700 1 Processor -- start 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.468+0000 7f064f328700 1 -- start start 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 0x7f064814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 0x7f0648150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0648159990 0x7f0648151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064814f750 con 0x7f06480cbed0 2023-08-09T14:15:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0648155990 con 0x7f06480c92b0 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.469+0000 7f064f328700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0648155c70 con 0x7f0648159990 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064c8c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 0x7f0648150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064c8c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 0x7f0648150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42986/0 (socket says 172.21.15.5:42986) 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064c8c3700 1 -- 172.21.15.5:0/836268179 learned_addr learned my addr 172.21.15.5:0/836268179 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 0x7f064814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d8c5700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0648159990 0x7f0648151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 -- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0648159990 msgr2=0x7f0648151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0648159990 0x7f0648151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 -- 172.21.15.5:0/836268179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 msgr2=0x7f0648150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 0x7f0648150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.471+0000 7f064d0c4700 1 -- 172.21.15.5:0/836268179 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644009cc0 con 0x7f06480c92b0 2023-08-09T14:15:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.472+0000 7f064d0c4700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 0x7f064814f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0644016000 tx=0x7f0644004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d40074600 con 0x7f0d4015b790 2023-08-09T14:15:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064401e070 con 0x7f06480c92b0 2023-08-09T14:15:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644006960 con 0x7f06480c92b0 2023-08-09T14:15:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440044c0 con 0x7f06480c92b0 2023-08-09T14:15:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0648155f50 con 0x7f06480c92b0 2023-08-09T14:15:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.476+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06481535c0 con 0x7f06480c92b0 2023-08-09T14:15:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.480+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0648074600 con 0x7f06480c92b0 2023-08-09T14:15:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.481+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0d300577a0 con 0x7f0d4015b790 2023-08-09T14:15:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.484+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06440036a0 con 0x7f06480c92b0 2023-08-09T14:15:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.484+0000 7f063dffb700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 0x7f062c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.484+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0644013030 con 0x7f06480c92b0 2023-08-09T14:15:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.485+0000 7f064c8c3700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 0x7f062c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.486+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0644055300 con 0x7f06480c92b0 2023-08-09T14:15:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.523+0000 7f064c8c3700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 0x7f062c06c640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f0638009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.811+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ff00055a0 con 0x7f10140c92b0 2023-08-09T14:15:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.812+0000 7f1003fff700 1 -- 172.21.15.5:0/2639544118 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f100c058ec0 con 0x7f10140c92b0 2023-08-09T14:15:35.817 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-08-09T14:15:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.815+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 msgr2=0x7f0ffc06c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.815+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 0x7f0ffc06c7d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10140c53e0 tx=0x7f1008009040 comp rx=0 tx=0).stop 2023-08-09T14:15:35.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.815+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 msgr2=0x7f10141ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.815+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 0x7f10141ef260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f100c014000 tx=0x7f100c004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 shutdown_connections 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0ffc06a310 0x7f0ffc06c7d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014159990 0x7f1014153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10140c92b0 0x7f10141ef260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 --2- 172.21.15.5:0/2639544118 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10140cbed0 0x7f1014151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 >> 172.21.15.5:0/2639544118 conn(0x7f10140b0850 msgr2=0x7f1014158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 shutdown_connections 2023-08-09T14:15:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.816+0000 7f1019d4b700 1 -- 172.21.15.5:0/2639544118 wait complete. 2023-08-09T14:15:35.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-09T14:15:35.842 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.856+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5eb8005870 con 0x7f5ed80b2f90 2023-08-09T14:15:35.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.857+0000 7f5ebffff700 1 -- 172.21.15.5:0/3837560417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ecc057260 con 0x7f5ed80b2f90 2023-08-09T14:15:35.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.857+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f08080c4c60 con 0x7f08080c40d0 2023-08-09T14:15:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.857+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe7a015dbe0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.860 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-08-09T14:15:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.860+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 msgr2=0x7f5ec406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.860+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 0x7f5ec406c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ed815db50 tx=0x7f5ec8006cb0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.860+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 msgr2=0x7f5ed81f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.860+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b470 tx=0x7f5ecc00b830 comp rx=0 tx=0).stop 2023-08-09T14:15:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.860+0000 7f08057fa700 1 -- 172.21.15.5:0/914665682 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08080c4c60 con 0x7f08080c40d0 2023-08-09T14:15:35.863 INFO:teuthology.orchestra.run.smithi005.stdout:60129542152 2023-08-09T14:15:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.862+0000 7fe7967fc700 1 -- 172.21.15.5:0/3920377411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7a015dbe0 con 0x7fe7a006bfe0 2023-08-09T14:15:35.864 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-08-09T14:15:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 msgr2=0x7f07ec06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 0x7f07ec06c670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07f4008de0 tx=0x7f07f4008390 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 msgr2=0x7f0808155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f080000a890 tx=0x7f080000aba0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 shutdown_connections 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f07ec06a1b0 0x7f07ec06c670 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08080c40d0 0x7f0808155b20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08080cb7c0 0x7f080814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 --2- 172.21.15.5:0/914665682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0808159990 0x7f08081555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 >> 172.21.15.5:0/914665682 conn(0x7f08080b0850 msgr2=0x7f080815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 shutdown_connections 2023-08-09T14:15:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5ec406a0e0 0x7f5ec406c5a0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ed815db50 tx=0x7f5ec8006cb0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ed815b1e0 0x7f5ed80b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed80b2f90 0x7f5ed81f6ed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 --2- 172.21.15.5:0/3837560417 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ed80cb590 0x7f5ed81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 >> 172.21.15.5:0/3837560417 conn(0x7f5ed80d0fd0 msgr2=0x7f5ed80b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3c040055a0 con 0x7f3c240caf90 2023-08-09T14:15:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.863+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 shutdown_connections 2023-08-09T14:15:35.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7f5eddda7700 1 -- 172.21.15.5:0/3837560417 wait complete. 2023-08-09T14:15:35.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7f3c0b7fe700 1 -- 172.21.15.5:0/1400808750 <== mon.2 v2:172.21.15.101:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c14056570 con 0x7f3c240caf90 2023-08-09T14:15:35.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 msgr2=0x7fe78406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 0x7fe78406c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00afbf0 tx=0x7fe790008040 comp rx=0 tx=0).stop 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 msgr2=0x7fe7a00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.864+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe79c004000 tx=0x7fe79c004750 comp rx=0 tx=0).stop 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 shutdown_connections 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe78406a0e0 0x7fe78406c5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe7a00cb7c0 0x7fe7a00aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a006bfe0 0x7fe7a00c4920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 --2- 172.21.15.5:0/3920377411 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe7a00b1340 0x7fe7a00ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.865+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 >> 172.21.15.5:0/3920377411 conn(0x7fe7a00b0850 msgr2=0x7fe7a00aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.866+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 shutdown_connections 2023-08-09T14:15:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.866+0000 7f080f121700 1 -- 172.21.15.5:0/914665682 wait complete. 2023-08-09T14:15:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.867+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbc6016a1c0 con 0x7fbc48009510 2023-08-09T14:15:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.867+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 shutdown_connections 2023-08-09T14:15:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.867+0000 7fe7a7bd6700 1 -- 172.21.15.5:0/3920377411 wait complete. 2023-08-09T14:15:35.872 INFO:teuthology.orchestra.run.smithi005.stdout:60129542153 2023-08-09T14:15:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.869+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 msgr2=0x7f3c1006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.869+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 0x7f3c1006c670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800dc60 tx=0x7f3c1800d000 comp rx=0 tx=0).stop 2023-08-09T14:15:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.869+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 msgr2=0x7f3c24165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.869+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 0x7f3c24165a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406b4e0 tx=0x7f3c1400c730 comp rx=0 tx=0).stop 2023-08-09T14:15:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 shutdown_connections 2023-08-09T14:15:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3c1006a1b0 0x7f3c1006c670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c2420bac0 0x7f3c2420bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3c240caf90 0x7f3c24165a70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 --2- 172.21.15.5:0/1400808750 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3c2416a1c0 0x7f3c240c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 >> 172.21.15.5:0/1400808750 conn(0x7f3c240b0850 msgr2=0x7f3c2416d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 shutdown_connections 2023-08-09T14:15:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.872+0000 7f3c29454700 1 -- 172.21.15.5:0/1400808750 wait complete. 2023-08-09T14:15:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.877+0000 7fbc477fe700 1 -- 172.21.15.5:0/1952431472 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc6016a1c0 con 0x7fbc48009510 2023-08-09T14:15:35.883 INFO:teuthology.orchestra.run.smithi005.stdout:60129542153 2023-08-09T14:15:35.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.1 2023-08-09T14:15:35.885 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.884+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 msgr2=0x7fbc4c06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.884+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 0x7fbc4c06c620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc600cd9d0 tx=0x7fbc54009040 comp rx=0 tx=0).stop 2023-08-09T14:15:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.884+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 msgr2=0x7fbc60168340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.884+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000b3a0 tx=0x7fbc5000b6b0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2023-08-09T14:15:35.887 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 shutdown_connections 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbc4c06a160 0x7fbc4c06c620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbc600c45f0 0x7fbc600c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc48009510 0x7fbc60168340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 --2- 172.21.15.5:0/1952431472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbc600b3b10 0x7fbc6016d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 >> 172.21.15.5:0/1952431472 conn(0x7fbc600b0850 msgr2=0x7fbc600af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 shutdown_connections 2023-08-09T14:15:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.885+0000 7fbc6561e700 1 -- 172.21.15.5:0/1952431472 wait complete. 2023-08-09T14:15:35.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2023-08-09T14:15:35.896 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.895+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d401555b0 con 0x7f0d4015b790 2023-08-09T14:15:35.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.6 2023-08-09T14:15:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.896+0000 7f0d3cff9700 1 -- 172.21.15.5:0/2394124091 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d401555b0 con 0x7f0d4015b790 2023-08-09T14:15:35.899 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-08-09T14:15:35.899 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.896+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0648074600 con 0x7f06480c92b0 2023-08-09T14:15:35.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.897+0000 7f063dffb700 1 -- 172.21.15.5:0/836268179 <== mon.1 v2:172.21.15.101:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0644058920 con 0x7f06480c92b0 2023-08-09T14:15:35.900 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-08-09T14:15:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 msgr2=0x7f0d2c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 0x7f0d2c06c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d400ca7e0 tx=0x7f0d38011000 comp rx=0 tx=0).stop 2023-08-09T14:15:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 msgr2=0x7f0d400c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000e900 tx=0x7f0d3000ecc0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 shutdown_connections 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0d2c06a130 0x7f0d2c06c5f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0d4015b790 0x7f0d400c2580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0d400ce410 0x7f0d40156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 --2- 172.21.15.5:0/2394124091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d4015b360 0x7f0d4006de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 >> 172.21.15.5:0/2394124091 conn(0x7f0d400b1900 msgr2=0x7f0d4015c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 shutdown_connections 2023-08-09T14:15:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.898+0000 7f0d46742700 1 -- 172.21.15.5:0/2394124091 wait complete. 2023-08-09T14:15:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 msgr2=0x7f062c06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 0x7f062c06c640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f0638009040 comp rx=0 tx=0).stop 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 msgr2=0x7f064814f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 0x7f064814f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0644016000 tx=0x7f0644004750 comp rx=0 tx=0).stop 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 shutdown_connections 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f062c06a180 0x7f062c06c640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0648159990 0x7f0648151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f06480c92b0 0x7f064814f210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 --2- 172.21.15.5:0/836268179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06480cbed0 0x7f0648150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 >> 172.21.15.5:0/836268179 conn(0x7f06480b0850 msgr2=0x7f06480ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 shutdown_connections 2023-08-09T14:15:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:35.899+0000 7f064f328700 1 -- 172.21.15.5:0/836268179 wait complete. 2023-08-09T14:15:35.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.4 2023-08-09T14:15:35.906 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-08-09T14:15:35.915 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-08-09T14:15:35.916 DEBUG:teuthology.parallel:result is None 2023-08-09T14:15:35.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-09T14:15:35.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:15:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.077+0000 7faa58c65700 1 Processor -- start 2023-08-09T14:15:36.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.077+0000 7faa58c65700 1 -- start start 2023-08-09T14:15:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 0x7faa540cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 0x7faa540b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa540b2f90 0x7faa540ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540b3420 con 0x7faa540b2f90 2023-08-09T14:15:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540cd880 con 0x7faa540cb590 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa58c65700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540d1e50 con 0x7faa5415b1e0 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa52d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa540b2f90 0x7faa540ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa52d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa540b2f90 0x7faa540ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42996/0 (socket says 172.21.15.5:42996) 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa52d9d700 1 -- 172.21.15.5:0/2904421504 learned_addr learned my addr 172.21.15.5:0/2904421504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.078+0000 7faa51d9b700 1 --2- 172.21.15.5:0/2904421504 >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 0x7faa540b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa5259c700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 0x7faa540cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 -- 172.21.15.5:0/2904421504 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 msgr2=0x7faa540cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 0x7faa540cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 -- 172.21.15.5:0/2904421504 >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 msgr2=0x7faa540b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 --2- 172.21.15.5:0/2904421504 >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 0x7faa540b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 -- 172.21.15.5:0/2904421504 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540cd5c0 con 0x7faa540b2f90 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa51d9b700 1 --2- 172.21.15.5:0/2904421504 >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 0x7faa540b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa5259c700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 0x7faa540cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa52d9d700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540b2f90 0x7faa540ceb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa5406de70 tx=0x7faa4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fd7125c02991a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa5159a700 1 -- 172.21.15.5:0/2904421504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00e070 con 0x7faa540b2f90 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa5159a700 1 -- 172.21.15.5:0/2904421504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c00b9c0 con 0x7faa540b2f90 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa5159a700 1 -- 172.21.15.5:0/2904421504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00bd70 con 0x7faa540b2f90 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa58c65700 1 -- 172.21.15.5:0/2904421504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540b2f90 msgr2=0x7faa540ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.079+0000 7faa58c65700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540b2f90 0x7faa540ceb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa5406de70 tx=0x7faa4c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 -- 172.21.15.5:0/2904421504 shutdown_connections 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540b2f90 0x7faa540ceb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 --2- 172.21.15.5:0/2904421504 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa5415b1e0 0x7faa540cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 --2- 172.21.15.5:0/2904421504 >> v2:172.21.15.101:3300/0 conn(0x7faa540cb590 0x7faa540b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 -- 172.21.15.5:0/2904421504 >> 172.21.15.5:0/2904421504 conn(0x7faa540d0fd0 msgr2=0x7faa540d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 -- 172.21.15.5:0/2904421504 shutdown_connections 2023-08-09T14:15:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.080+0000 7faa58c65700 1 -- 172.21.15.5:0/2904421504 wait complete. 2023-08-09T14:15:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.081+0000 7faa58c65700 1 Processor -- start 2023-08-09T14:15:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.081+0000 7faa58c65700 1 -- start start 2023-08-09T14:15:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa540b2f90 0x7faa540b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 0x7faa540c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540c5ac0 con 0x7faa540cb590 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5406c660 con 0x7faa5415b1e0 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540c8d90 con 0x7faa540b2f90 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43000/0 (socket says 172.21.15.5:43000) 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 -- 172.21.15.5:0/2261916662 learned_addr learned my addr 172.21.15.5:0/2261916662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa52d9d700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 0x7faa540c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa5259c700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa540b2f90 0x7faa540b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 -- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa540b2f90 msgr2=0x7faa540b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa540b2f90 0x7faa540b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 -- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 msgr2=0x7faa540c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 0x7faa540c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 -- 172.21.15.5:0/2261916662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009b30 con 0x7faa540cb590 2023-08-09T14:15:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa52d9d700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 0x7faa540c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa51d9b700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa4400d800 tx=0x7faa4400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44004030 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44004190 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540c9070 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.082+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44004520 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.083+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540c5fb0 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.083+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa540c9200 con 0x7faa540cb590 2023-08-09T14:15:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.084+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa440036a0 con 0x7faa540cb590 2023-08-09T14:15:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.084+0000 7faa42ffd700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 0x7faa3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.085+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa44088bc0 con 0x7faa540cb590 2023-08-09T14:15:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.085+0000 7faa5259c700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 0x7faa3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.085+0000 7faa5259c700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 0x7faa3406c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa48006fd0 tx=0x7faa48008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.089+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7faa44057d30 con 0x7faa540cb590 2023-08-09T14:15:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.285+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa5406fac0 con 0x7faa3406a0e0 2023-08-09T14:15:36.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.294+0000 7faa42ffd700 1 -- 172.21.15.5:0/2261916662 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286853 (secure 0 0 0) 0x7faa4800c050 con 0x7faa3406a0e0 2023-08-09T14:15:36.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 msgr2=0x7faa3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 0x7faa3406c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa48006fd0 tx=0x7faa48008040 comp rx=0 tx=0).stop 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 msgr2=0x7faa5406cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa4400d800 tx=0x7faa4400dbc0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 shutdown_connections 2023-08-09T14:15:36.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7faa3406a0e0 0x7faa3406c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7faa5415b1e0 0x7faa540c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7faa540b2f90 0x7faa540b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 --2- 172.21.15.5:0/2261916662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa540cb590 0x7faa5406cce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 >> 172.21.15.5:0/2261916662 conn(0x7faa540d0fd0 msgr2=0x7faa541598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 shutdown_connections 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.297+0000 7faa58c65700 1 -- 172.21.15.5:0/2261916662 wait complete. 2023-08-09T14:15:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-09T14:15:35.784129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2880,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2949120,"data_stored":1809406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.435466"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714534+0000","last_change":"2023-08-09T14:15:27.359010+0000","last_active":"2023-08-09T14:15:28.714534+0000","last_peered":"2023-08-09T14:15:28.714534+0000","last_clean":"2023-08-09T14:15:28.714534+0000","last_became_active":"2023-08-09T14:15:27.358323+0000","last_became_peered":"2023-08-09T14:15:27.358323+0000","last_unstale":"2023-08-09T14:15:28.714534+0000","last_undegraded":"2023-08-09T14:15:28.714534+0000","last_fullsized":"2023-08-09T14:15:28.714534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:03.815478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714970+0000","last_change":"2023-08-09T14:15:27.367989+0000","last_active":"2023-08-09T14:15:28.714970+0000","last_peered":"2023-08-09T14:15:28.714970+0000","last_clean":"2023-08-09T14:15:28.714970+0000","last_became_active":"2023-08-09T14:15:27.367673+0000","last_became_peered":"2023-08-09T14:15:27.367673+0000","last_unstale":"2023-08-09T14:15:28.714970+0000","last_undegraded":"2023-08-09T14:15:28.714970+0000","last_fullsized":"2023-08-09T14:15:28.714970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364961+0000","last_change":"2023-08-09T14:15:27.363689+0000","last_active":"2023-08-09T14:15:28.364961+0000","last_peered":"2023-08-09T14:15:28.364961+0000","last_clean":"2023-08-09T14:15:28.364961+0000","last_became_active":"2023-08-09T14:15:27.362860+0000","last_became_peered":"2023-08-09T14:15:27.362860+0000","last_unstale":"2023-08-09T14:15:28.364961+0000","last_undegraded":"2023-08-09T14:15:28.364961+0000","last_fullsized":"2023-08-09T14:15:28.364961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714809+0000","last_change":"2023-08-09T14:15:27.373792+0000","last_active":"2023-08-09T14:15:28.714809+0000","last_peered":"2023-08-09T14:15:28.714809+0000","last_clean":"2023-08-09T14:15:28.714809+0000","last_became_active":"2023-08-09T14:15:27.373509+0000","last_became_peered":"2023-08-09T14:15:27.373509+0000","last_unstale":"2023-08-09T14:15:28.714809+0000","last_undegraded":"2023-08-09T14:15:28.714809+0000","last_fullsized":"2023-08-09T14:15:28.714809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:22.780067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715145+0000","last_change":"2023-08-09T14:15:27.362006+0000","last_active":"2023-08-09T14:15:28.715145+0000","last_peered":"2023-08-09T14:15:28.715145+0000","last_clean":"2023-08-09T14:15:28.715145+0000","last_became_active":"2023-08-09T14:15:27.361703+0000","last_became_peered":"2023-08-09T14:15:27.361703+0000","last_unstale":"2023-08-09T14:15:28.715145+0000","last_undegraded":"2023-08-09T14:15:28.715145+0000","last_fullsized":"2023-08-09T14:15:28.715145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363995+0000","last_change":"2023-08-09T14:15:27.368188+0000","last_active":"2023-08-09T14:15:28.363995+0000","last_peered":"2023-08-09T14:15:28.363995+0000","last_clean":"2023-08-09T14:15:28.363995+0000","last_became_active":"2023-08-09T14:15:27.367964+0000","last_became_peered":"2023-08-09T14:15:27.367964+0000","last_unstale":"2023-08-09T14:15:28.363995+0000","last_undegraded":"2023-08-09T14:15:28.363995+0000","last_fullsized":"2023-08-09T14:15:28.363995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365249+0000","last_change":"2023-08-09T14:15:27.374050+0000","last_active":"2023-08-09T14:15:28.365249+0000","last_peered":"2023-08-09T14:15:28.365249+0000","last_clean":"2023-08-09T14:15:28.365249+0000","last_became_active":"2023-08-09T14:15:27.373773+0000","last_became_peered":"2023-08-09T14:15:27.373773+0000","last_unstale":"2023-08-09T14:15:28.365249+0000","last_undegraded":"2023-08-09T14:15:28.365249+0000","last_fullsized":"2023-08-09T14:15:28.365249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714972+0000","last_change":"2023-08-09T14:15:27.363180+0000","last_active":"2023-08-09T14:15:28.714972+0000","last_peered":"2023-08-09T14:15:28.714972+0000","last_clean":"2023-08-09T14:15:28.714972+0000","last_became_active":"2023-08-09T14:15:27.362900+0000","last_became_peered":"2023-08-09T14:15:27.362900+0000","last_unstale":"2023-08-09T14:15:28.714972+0000","last_undegraded":"2023-08-09T14:15:28.714972+0000","last_fullsized":"2023-08-09T14:15:28.714972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716296+0000","last_change":"2023-08-09T14:15:27.372871+0000","last_active":"2023-08-09T14:15:28.716296+0000","last_peered":"2023-08-09T14:15:28.716296+0000","last_clean":"2023-08-09T14:15:28.716296+0000","last_became_active":"2023-08-09T14:15:27.372498+0000","last_became_peered":"2023-08-09T14:15:27.372498+0000","last_unstale":"2023-08-09T14:15:28.716296+0000","last_undegraded":"2023-08-09T14:15:28.716296+0000","last_fullsized":"2023-08-09T14:15:28.716296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715540+0000","last_change":"2023-08-09T14:15:27.371102+0000","last_active":"2023-08-09T14:15:28.715540+0000","last_peered":"2023-08-09T14:15:28.715540+0000","last_clean":"2023-08-09T14:15:28.715540+0000","last_became_active":"2023-08-09T14:15:27.369324+0000","last_became_peered":"2023-08-09T14:15:27.369324+0000","last_unstale":"2023-08-09T14:15:28.715540+0000","last_undegraded":"2023-08-09T14:15:28.715540+0000","last_fullsized":"2023-08-09T14:15:28.715540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365879+0000","last_change":"2023-08-09T14:15:27.365332+0000","last_active":"2023-08-09T14:15:28.365879+0000","last_peered":"2023-08-09T14:15:28.365879+0000","last_clean":"2023-08-09T14:15:28.365879+0000","last_became_active":"2023-08-09T14:15:27.365006+0000","last_became_peered":"2023-08-09T14:15:27.365006+0000","last_unstale":"2023-08-09T14:15:28.365879+0000","last_undegraded":"2023-08-09T14:15:28.365879+0000","last_fullsized":"2023-08-09T14:15:28.365879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:30.980568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714590+0000","last_change":"2023-08-09T14:15:27.358952+0000","last_active":"2023-08-09T14:15:28.714590+0000","last_peered":"2023-08-09T14:15:28.714590+0000","last_clean":"2023-08-09T14:15:28.714590+0000","last_became_active":"2023-08-09T14:15:27.357896+0000","last_became_peered":"2023-08-09T14:15:27.357896+0000","last_unstale":"2023-08-09T14:15:28.714590+0000","last_undegraded":"2023-08-09T14:15:28.714590+0000","last_fullsized":"2023-08-09T14:15:28.714590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:25.276374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714853+0000","last_change":"2023-08-09T14:15:27.358714+0000","last_active":"2023-08-09T14:15:28.714853+0000","last_peered":"2023-08-09T14:15:28.714853+0000","last_clean":"2023-08-09T14:15:28.714853+0000","last_became_active":"2023-08-09T14:15:27.358414+0000","last_became_peered":"2023-08-09T14:15:27.358414+0000","last_unstale":"2023-08-09T14:15:28.714853+0000","last_undegraded":"2023-08-09T14:15:28.714853+0000","last_fullsized":"2023-08-09T14:15:28.714853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:01.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715151+0000","last_change":"2023-08-09T14:15:27.368320+0000","last_active":"2023-08-09T14:15:28.715151+0000","last_peered":"2023-08-09T14:15:28.715151+0000","last_clean":"2023-08-09T14:15:28.715151+0000","last_became_active":"2023-08-09T14:15:27.368012+0000","last_became_peered":"2023-08-09T14:15:27.368012+0000","last_unstale":"2023-08-09T14:15:28.715151+0000","last_undegraded":"2023-08-09T14:15:28.715151+0000","last_fullsized":"2023-08-09T14:15:28.715151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365423+0000","last_change":"2023-08-09T14:15:27.377127+0000","last_active":"2023-08-09T14:15:28.365423+0000","last_peered":"2023-08-09T14:15:28.365423+0000","last_clean":"2023-08-09T14:15:28.365423+0000","last_became_active":"2023-08-09T14:15:27.376816+0000","last_became_peered":"2023-08-09T14:15:27.376816+0000","last_unstale":"2023-08-09T14:15:28.365423+0000","last_undegraded":"2023-08-09T14:15:28.365423+0000","last_fullsized":"2023-08-09T14:15:28.365423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364162+0000","last_change":"2023-08-09T14:15:27.368513+0000","last_active":"2023-08-09T14:15:28.364162+0000","last_peered":"2023-08-09T14:15:28.364162+0000","last_clean":"2023-08-09T14:15:28.364162+0000","last_became_active":"2023-08-09T14:15:27.368213+0000","last_became_peered":"2023-08-09T14:15:27.368213+0000","last_unstale":"2023-08-09T14:15:28.364162+0000","last_undegraded":"2023-08-09T14:15:28.364162+0000","last_fullsized":"2023-08-09T14:15:28.364162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715429+0000","last_change":"2023-08-09T14:15:27.372568+0000","last_active":"2023-08-09T14:15:28.715429+0000","last_peered":"2023-08-09T14:15:28.715429+0000","last_clean":"2023-08-09T14:15:28.715429+0000","last_became_active":"2023-08-09T14:15:27.372090+0000","last_became_peered":"2023-08-09T14:15:27.372090+0000","last_unstale":"2023-08-09T14:15:28.715429+0000","last_undegraded":"2023-08-09T14:15:28.715429+0000","last_fullsized":"2023-08-09T14:15:28.715429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365588+0000","last_change":"2023-08-09T14:15:27.362581+0000","last_active":"2023-08-09T14:15:28.365588+0000","last_peered":"2023-08-09T14:15:28.365588+0000","last_clean":"2023-08-09T14:15:28.365588+0000","last_became_active":"2023-08-09T14:15:27.362258+0000","last_became_peered":"2023-08-09T14:15:27.362258+0000","last_unstale":"2023-08-09T14:15:28.365588+0000","last_undegraded":"2023-08-09T14:15:28.365588+0000","last_fullsized":"2023-08-09T14:15:28.365588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:41:12.126098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.374336+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.374042+0000","last_became_peered":"2023-08-09T14:15:27.374042+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:59.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365710+0000","last_change":"2023-08-09T14:15:27.374636+0000","last_active":"2023-08-09T14:15:28.365710+0000","last_peered":"2023-08-09T14:15:28.365710+0000","last_clean":"2023-08-09T14:15:28.365710+0000","last_became_active":"2023-08-09T14:15:27.374373+0000","last_became_peered":"2023-08-09T14:15:27.374373+0000","last_unstale":"2023-08-09T14:15:28.365710+0000","last_undegraded":"2023-08-09T14:15:28.365710+0000","last_fullsized":"2023-08-09T14:15:28.365710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:47:45.522434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365339+0000","last_change":"2023-08-09T14:15:27.371398+0000","last_active":"2023-08-09T14:15:28.365339+0000","last_peered":"2023-08-09T14:15:28.365339+0000","last_clean":"2023-08-09T14:15:28.365339+0000","last_became_active":"2023-08-09T14:15:27.371094+0000","last_became_peered":"2023-08-09T14:15:27.371094+0000","last_unstale":"2023-08-09T14:15:28.365339+0000","last_undegraded":"2023-08-09T14:15:28.365339+0000","last_fullsized":"2023-08-09T14:15:28.365339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714891+0000","last_change":"2023-08-09T14:15:27.373020+0000","last_active":"2023-08-09T14:15:28.714891+0000","last_peered":"2023-08-09T14:15:28.714891+0000","last_clean":"2023-08-09T14:15:28.714891+0000","last_became_active":"2023-08-09T14:15:27.371864+0000","last_became_peered":"2023-08-09T14:15:27.371864+0000","last_unstale":"2023-08-09T14:15:28.714891+0000","last_undegraded":"2023-08-09T14:15:28.714891+0000","last_fullsized":"2023-08-09T14:15:28.714891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715197+0000","last_change":"2023-08-09T14:15:27.360056+0000","last_active":"2023-08-09T14:15:28.715197+0000","last_peered":"2023-08-09T14:15:28.715197+0000","last_clean":"2023-08-09T14:15:28.715197+0000","last_became_active":"2023-08-09T14:15:27.359789+0000","last_became_peered":"2023-08-09T14:15:27.359789+0000","last_unstale":"2023-08-09T14:15:28.715197+0000","last_undegraded":"2023-08-09T14:15:28.715197+0000","last_fullsized":"2023-08-09T14:15:28.715197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364182+0000","last_change":"2023-08-09T14:15:27.370713+0000","last_active":"2023-08-09T14:15:28.364182+0000","last_peered":"2023-08-09T14:15:28.364182+0000","last_clean":"2023-08-09T14:15:28.364182+0000","last_became_active":"2023-08-09T14:15:27.370350+0000","last_became_peered":"2023-08-09T14:15:27.370350+0000","last_unstale":"2023-08-09T14:15:28.364182+0000","last_undegraded":"2023-08-09T14:15:28.364182+0000","last_fullsized":"2023-08-09T14:15:28.364182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.376534+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.376246+0000","last_became_peered":"2023-08-09T14:15:27.376246+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363636+0000","last_change":"2023-08-09T14:15:27.371361+0000","last_active":"2023-08-09T14:15:28.363636+0000","last_peered":"2023-08-09T14:15:28.363636+0000","last_clean":"2023-08-09T14:15:28.363636+0000","last_became_active":"2023-08-09T14:15:27.371080+0000","last_became_peered":"2023-08-09T14:15:27.371080+0000","last_unstale":"2023-08-09T14:15:28.363636+0000","last_undegraded":"2023-08-09T14:15:28.363636+0000","last_fullsized":"2023-08-09T14:15:28.363636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715083+0000","last_change":"2023-08-09T14:15:27.368916+0000","last_active":"2023-08-09T14:15:28.715083+0000","last_peered":"2023-08-09T14:15:28.715083+0000","last_clean":"2023-08-09T14:15:28.715083+0000","last_became_active":"2023-08-09T14:15:27.367870+0000","last_became_peered":"2023-08-09T14:15:27.367870+0000","last_unstale":"2023-08-09T14:15:28.715083+0000","last_undegraded":"2023-08-09T14:15:28.715083+0000","last_fullsized":"2023-08-09T14:15:28.715083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364479+0000","last_change":"2023-08-09T14:15:26.362153+0000","last_active":"2023-08-09T14:15:28.364479+0000","last_peered":"2023-08-09T14:15:28.364479+0000","last_clean":"2023-08-09T14:15:28.364479+0000","last_became_active":"2023-08-09T14:15:26.361870+0000","last_became_peered":"2023-08-09T14:15:26.361870+0000","last_unstale":"2023-08-09T14:15:28.364479+0000","last_undegraded":"2023-08-09T14:15:28.364479+0000","last_fullsized":"2023-08-09T14:15:28.364479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715977+0000","last_change":"2023-08-09T14:15:27.365726+0000","last_active":"2023-08-09T14:15:28.715977+0000","last_peered":"2023-08-09T14:15:28.715977+0000","last_clean":"2023-08-09T14:15:28.715977+0000","last_became_active":"2023-08-09T14:15:27.365446+0000","last_became_peered":"2023-08-09T14:15:27.365446+0000","last_unstale":"2023-08-09T14:15:28.715977+0000","last_undegraded":"2023-08-09T14:15:28.715977+0000","last_fullsized":"2023-08-09T14:15:28.715977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363356+0000","last_change":"2023-08-09T14:15:26.366707+0000","last_active":"2023-08-09T14:15:28.363356+0000","last_peered":"2023-08-09T14:15:28.363356+0000","last_clean":"2023-08-09T14:15:28.363356+0000","last_became_active":"2023-08-09T14:15:26.366353+0000","last_became_peered":"2023-08-09T14:15:26.366353+0000","last_unstale":"2023-08-09T14:15:28.363356+0000","last_undegraded":"2023-08-09T14:15:28.363356+0000","last_fullsized":"2023-08-09T14:15:28.363356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:29.574516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715297+0000","last_change":"2023-08-09T14:15:27.368533+0000","last_active":"2023-08-09T14:15:28.715297+0000","last_peered":"2023-08-09T14:15:28.715297+0000","last_clean":"2023-08-09T14:15:28.715297+0000","last_became_active":"2023-08-09T14:15:27.368106+0000","last_became_peered":"2023-08-09T14:15:27.368106+0000","last_unstale":"2023-08-09T14:15:28.715297+0000","last_undegraded":"2023-08-09T14:15:28.715297+0000","last_fullsized":"2023-08-09T14:15:28.715297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715671+0000","last_change":"2023-08-09T14:15:26.363963+0000","last_active":"2023-08-09T14:15:28.715671+0000","last_peered":"2023-08-09T14:15:28.715671+0000","last_clean":"2023-08-09T14:15:28.715671+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715671+0000","last_undegraded":"2023-08-09T14:15:28.715671+0000","last_fullsized":"2023-08-09T14:15:28.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715478+0000","last_change":"2023-08-09T14:15:27.373373+0000","last_active":"2023-08-09T14:15:28.715478+0000","last_peered":"2023-08-09T14:15:28.715478+0000","last_clean":"2023-08-09T14:15:28.715478+0000","last_became_active":"2023-08-09T14:15:27.373052+0000","last_became_peered":"2023-08-09T14:15:27.373052+0000","last_unstale":"2023-08-09T14:15:28.715478+0000","last_undegraded":"2023-08-09T14:15:28.715478+0000","last_fullsized":"2023-08-09T14:15:28.715478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715542+0000","last_change":"2023-08-09T14:15:26.364578+0000","last_active":"2023-08-09T14:15:28.715542+0000","last_peered":"2023-08-09T14:15:28.715542+0000","last_clean":"2023-08-09T14:15:28.715542+0000","last_became_active":"2023-08-09T14:15:26.364070+0000","last_became_peered":"2023-08-09T14:15:26.364070+0000","last_unstale":"2023-08-09T14:15:28.715542+0000","last_undegraded":"2023-08-09T14:15:28.715542+0000","last_fullsized":"2023-08-09T14:15:28.715542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715566+0000","last_change":"2023-08-09T14:15:27.364655+0000","last_active":"2023-08-09T14:15:28.715566+0000","last_peered":"2023-08-09T14:15:28.715566+0000","last_clean":"2023-08-09T14:15:28.715566+0000","last_became_active":"2023-08-09T14:15:27.364316+0000","last_became_peered":"2023-08-09T14:15:27.364316+0000","last_unstale":"2023-08-09T14:15:28.715566+0000","last_undegraded":"2023-08-09T14:15:28.715566+0000","last_fullsized":"2023-08-09T14:15:28.715566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:02.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715462+0000","last_change":"2023-08-09T14:15:26.355952+0000","last_active":"2023-08-09T14:15:28.715462+0000","last_peered":"2023-08-09T14:15:28.715462+0000","last_clean":"2023-08-09T14:15:28.715462+0000","last_became_active":"2023-08-09T14:15:26.355504+0000","last_became_peered":"2023-08-09T14:15:26.355504+0000","last_unstale":"2023-08-09T14:15:28.715462+0000","last_undegraded":"2023-08-09T14:15:28.715462+0000","last_fullsized":"2023-08-09T14:15:28.715462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:16.905292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715749+0000","last_change":"2023-08-09T14:15:27.366627+0000","last_active":"2023-08-09T14:15:28.715749+0000","last_peered":"2023-08-09T14:15:28.715749+0000","last_clean":"2023-08-09T14:15:28.715749+0000","last_became_active":"2023-08-09T14:15:27.366355+0000","last_became_peered":"2023-08-09T14:15:27.366355+0000","last_unstale":"2023-08-09T14:15:28.715749+0000","last_undegraded":"2023-08-09T14:15:28.715749+0000","last_fullsized":"2023-08-09T14:15:28.715749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:31.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365449+0000","last_change":"2023-08-09T14:15:26.369077+0000","last_active":"2023-08-09T14:15:28.365449+0000","last_peered":"2023-08-09T14:15:28.365449+0000","last_clean":"2023-08-09T14:15:28.365449+0000","last_became_active":"2023-08-09T14:15:26.368729+0000","last_became_peered":"2023-08-09T14:15:26.368729+0000","last_unstale":"2023-08-09T14:15:28.365449+0000","last_undegraded":"2023-08-09T14:15:28.365449+0000","last_fullsized":"2023-08-09T14:15:28.365449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:31.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363694+0000","last_change":"2023-08-09T14:15:27.376850+0000","last_active":"2023-08-09T14:15:28.363694+0000","last_peered":"2023-08-09T14:15:28.363694+0000","last_clean":"2023-08-09T14:15:28.363694+0000","last_became_active":"2023-08-09T14:15:27.376373+0000","last_became_peered":"2023-08-09T14:15:27.376373+0000","last_unstale":"2023-08-09T14:15:28.363694+0000","last_undegraded":"2023-08-09T14:15:28.363694+0000","last_fullsized":"2023-08-09T14:15:28.363694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365232+0000","last_change":"2023-08-09T14:15:26.356121+0000","last_active":"2023-08-09T14:15:28.365232+0000","last_peered":"2023-08-09T14:15:28.365232+0000","last_clean":"2023-08-09T14:15:28.365232+0000","last_became_active":"2023-08-09T14:15:26.355766+0000","last_became_peered":"2023-08-09T14:15:26.355766+0000","last_unstale":"2023-08-09T14:15:28.365232+0000","last_undegraded":"2023-08-09T14:15:28.365232+0000","last_fullsized":"2023-08-09T14:15:28.365232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:05.063045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365844+0000","last_change":"2023-08-09T14:15:27.373146+0000","last_active":"2023-08-09T14:15:28.365844+0000","last_peered":"2023-08-09T14:15:28.365844+0000","last_clean":"2023-08-09T14:15:28.365844+0000","last_became_active":"2023-08-09T14:15:27.372860+0000","last_became_peered":"2023-08-09T14:15:27.372860+0000","last_unstale":"2023-08-09T14:15:28.365844+0000","last_undegraded":"2023-08-09T14:15:28.365844+0000","last_fullsized":"2023-08-09T14:15:28.365844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:19:06.218840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365182+0000","last_change":"2023-08-09T14:15:26.359070+0000","last_active":"2023-08-09T14:15:28.365182+0000","last_peered":"2023-08-09T14:15:28.365182+0000","last_clean":"2023-08-09T14:15:28.365182+0000","last_became_active":"2023-08-09T14:15:26.357308+0000","last_became_peered":"2023-08-09T14:15:26.357308+0000","last_unstale":"2023-08-09T14:15:28.365182+0000","last_undegraded":"2023-08-09T14:15:28.365182+0000","last_fullsized":"2023-08-09T14:15:28.365182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715653+0000","last_change":"2023-08-09T14:15:27.373211+0000","last_active":"2023-08-09T14:15:28.715653+0000","last_peered":"2023-08-09T14:15:28.715653+0000","last_clean":"2023-08-09T14:15:28.715653+0000","last_became_active":"2023-08-09T14:15:27.372904+0000","last_became_peered":"2023-08-09T14:15:27.372904+0000","last_unstale":"2023-08-09T14:15:28.715653+0000","last_undegraded":"2023-08-09T14:15:28.715653+0000","last_fullsized":"2023-08-09T14:15:28.715653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714978+0000","last_change":"2023-08-09T14:15:26.365445+0000","last_active":"2023-08-09T14:15:28.714978+0000","last_peered":"2023-08-09T14:15:28.714978+0000","last_clean":"2023-08-09T14:15:28.714978+0000","last_became_active":"2023-08-09T14:15:26.365146+0000","last_became_peered":"2023-08-09T14:15:26.365146+0000","last_unstale":"2023-08-09T14:15:28.714978+0000","last_undegraded":"2023-08-09T14:15:28.714978+0000","last_fullsized":"2023-08-09T14:15:28.714978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715163+0000","last_change":"2023-08-09T14:15:27.368128+0000","last_active":"2023-08-09T14:15:28.715163+0000","last_peered":"2023-08-09T14:15:28.715163+0000","last_clean":"2023-08-09T14:15:28.715163+0000","last_became_active":"2023-08-09T14:15:27.365878+0000","last_became_peered":"2023-08-09T14:15:27.365878+0000","last_unstale":"2023-08-09T14:15:28.715163+0000","last_undegraded":"2023-08-09T14:15:28.715163+0000","last_fullsized":"2023-08-09T14:15:28.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365331+0000","last_change":"2023-08-09T14:15:26.362477+0000","last_active":"2023-08-09T14:15:28.365331+0000","last_peered":"2023-08-09T14:15:28.365331+0000","last_clean":"2023-08-09T14:15:28.365331+0000","last_became_active":"2023-08-09T14:15:26.362201+0000","last_became_peered":"2023-08-09T14:15:26.362201+0000","last_unstale":"2023-08-09T14:15:28.365331+0000","last_undegraded":"2023-08-09T14:15:28.365331+0000","last_fullsized":"2023-08-09T14:15:28.365331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715086+0000","last_change":"2023-08-09T14:15:27.368351+0000","last_active":"2023-08-09T14:15:28.715086+0000","last_peered":"2023-08-09T14:15:28.715086+0000","last_clean":"2023-08-09T14:15:28.715086+0000","last_became_active":"2023-08-09T14:15:27.367354+0000","last_became_peered":"2023-08-09T14:15:27.367354+0000","last_unstale":"2023-08-09T14:15:28.715086+0000","last_undegraded":"2023-08-09T14:15:28.715086+0000","last_fullsized":"2023-08-09T14:15:28.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714566+0000","last_change":"2023-08-09T14:15:26.364067+0000","last_active":"2023-08-09T14:15:28.714566+0000","last_peered":"2023-08-09T14:15:28.714566+0000","last_clean":"2023-08-09T14:15:28.714566+0000","last_became_active":"2023-08-09T14:15:26.363763+0000","last_became_peered":"2023-08-09T14:15:26.363763+0000","last_unstale":"2023-08-09T14:15:28.714566+0000","last_undegraded":"2023-08-09T14:15:28.714566+0000","last_fullsized":"2023-08-09T14:15:28.714566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:13.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716271+0000","last_change":"2023-08-09T14:15:27.367007+0000","last_active":"2023-08-09T14:15:28.716271+0000","last_peered":"2023-08-09T14:15:28.716271+0000","last_clean":"2023-08-09T14:15:28.716271+0000","last_became_active":"2023-08-09T14:15:27.366701+0000","last_became_peered":"2023-08-09T14:15:27.366701+0000","last_unstale":"2023-08-09T14:15:28.716271+0000","last_undegraded":"2023-08-09T14:15:28.716271+0000","last_fullsized":"2023-08-09T14:15:28.716271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364911+0000","last_change":"2023-08-09T14:15:26.358111+0000","last_active":"2023-08-09T14:15:28.364911+0000","last_peered":"2023-08-09T14:15:28.364911+0000","last_clean":"2023-08-09T14:15:28.364911+0000","last_became_active":"2023-08-09T14:15:26.357775+0000","last_became_peered":"2023-08-09T14:15:26.357775+0000","last_unstale":"2023-08-09T14:15:28.364911+0000","last_undegraded":"2023-08-09T14:15:28.364911+0000","last_fullsized":"2023-08-09T14:15:28.364911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:02.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715182+0000","last_change":"2023-08-09T14:15:27.370898+0000","last_active":"2023-08-09T14:15:28.715182+0000","last_peered":"2023-08-09T14:15:28.715182+0000","last_clean":"2023-08-09T14:15:28.715182+0000","last_became_active":"2023-08-09T14:15:27.370605+0000","last_became_peered":"2023-08-09T14:15:27.370605+0000","last_unstale":"2023-08-09T14:15:28.715182+0000","last_undegraded":"2023-08-09T14:15:28.715182+0000","last_fullsized":"2023-08-09T14:15:28.715182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364888+0000","last_change":"2023-08-09T14:15:26.356264+0000","last_active":"2023-08-09T14:15:28.364888+0000","last_peered":"2023-08-09T14:15:28.364888+0000","last_clean":"2023-08-09T14:15:28.364888+0000","last_became_active":"2023-08-09T14:15:26.355974+0000","last_became_peered":"2023-08-09T14:15:26.355974+0000","last_unstale":"2023-08-09T14:15:28.364888+0000","last_undegraded":"2023-08-09T14:15:28.364888+0000","last_fullsized":"2023-08-09T14:15:28.364888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364131+0000","last_change":"2023-08-09T14:15:27.364910+0000","last_active":"2023-08-09T14:15:28.364131+0000","last_peered":"2023-08-09T14:15:28.364131+0000","last_clean":"2023-08-09T14:15:28.364131+0000","last_became_active":"2023-08-09T14:15:27.364633+0000","last_became_peered":"2023-08-09T14:15:27.364633+0000","last_unstale":"2023-08-09T14:15:28.364131+0000","last_undegraded":"2023-08-09T14:15:28.364131+0000","last_fullsized":"2023-08-09T14:15:28.364131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365252+0000","last_change":"2023-08-09T14:15:26.359582+0000","last_active":"2023-08-09T14:15:28.365252+0000","last_peered":"2023-08-09T14:15:28.365252+0000","last_clean":"2023-08-09T14:15:28.365252+0000","last_became_active":"2023-08-09T14:15:26.358709+0000","last_became_peered":"2023-08-09T14:15:26.358709+0000","last_unstale":"2023-08-09T14:15:28.365252+0000","last_undegraded":"2023-08-09T14:15:28.365252+0000","last_fullsized":"2023-08-09T14:15:28.365252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:37.757503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715501+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715501+0000","last_peered":"2023-08-09T14:15:28.715501+0000","last_clean":"2023-08-09T14:15:28.715501+0000","last_became_active":"2023-08-09T14:15:27.376934+0000","last_became_peered":"2023-08-09T14:15:27.376934+0000","last_unstale":"2023-08-09T14:15:28.715501+0000","last_undegraded":"2023-08-09T14:15:28.715501+0000","last_fullsized":"2023-08-09T14:15:28.715501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715282+0000","last_change":"2023-08-09T14:15:26.361599+0000","last_active":"2023-08-09T14:15:28.715282+0000","last_peered":"2023-08-09T14:15:28.715282+0000","last_clean":"2023-08-09T14:15:28.715282+0000","last_became_active":"2023-08-09T14:15:26.361344+0000","last_became_peered":"2023-08-09T14:15:26.361344+0000","last_unstale":"2023-08-09T14:15:28.715282+0000","last_undegraded":"2023-08-09T14:15:28.715282+0000","last_fullsized":"2023-08-09T14:15:28.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:54.887960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714818+0000","last_change":"2023-08-09T14:15:27.377369+0000","last_active":"2023-08-09T14:15:28.714818+0000","last_peered":"2023-08-09T14:15:28.714818+0000","last_clean":"2023-08-09T14:15:28.714818+0000","last_became_active":"2023-08-09T14:15:27.376969+0000","last_became_peered":"2023-08-09T14:15:27.376969+0000","last_unstale":"2023-08-09T14:15:28.714818+0000","last_undegraded":"2023-08-09T14:15:28.714818+0000","last_fullsized":"2023-08-09T14:15:28.714818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715897+0000","last_change":"2023-08-09T14:15:26.365316+0000","last_active":"2023-08-09T14:15:28.715897+0000","last_peered":"2023-08-09T14:15:28.715897+0000","last_clean":"2023-08-09T14:15:28.715897+0000","last_became_active":"2023-08-09T14:15:26.365027+0000","last_became_peered":"2023-08-09T14:15:26.365027+0000","last_unstale":"2023-08-09T14:15:28.715897+0000","last_undegraded":"2023-08-09T14:15:28.715897+0000","last_fullsized":"2023-08-09T14:15:28.715897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365111+0000","last_change":"2023-08-09T14:15:27.364606+0000","last_active":"2023-08-09T14:15:28.365111+0000","last_peered":"2023-08-09T14:15:28.365111+0000","last_clean":"2023-08-09T14:15:28.365111+0000","last_became_active":"2023-08-09T14:15:27.364110+0000","last_became_peered":"2023-08-09T14:15:27.364110+0000","last_unstale":"2023-08-09T14:15:28.365111+0000","last_undegraded":"2023-08-09T14:15:28.365111+0000","last_fullsized":"2023-08-09T14:15:28.365111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715355+0000","last_change":"2023-08-09T14:15:26.364188+0000","last_active":"2023-08-09T14:15:28.715355+0000","last_peered":"2023-08-09T14:15:28.715355+0000","last_clean":"2023-08-09T14:15:28.715355+0000","last_became_active":"2023-08-09T14:15:26.363813+0000","last_became_peered":"2023-08-09T14:15:26.363813+0000","last_unstale":"2023-08-09T14:15:28.715355+0000","last_undegraded":"2023-08-09T14:15:28.715355+0000","last_fullsized":"2023-08-09T14:15:28.715355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:54.109205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365408+0000","last_change":"2023-08-09T14:15:27.361904+0000","last_active":"2023-08-09T14:15:28.365408+0000","last_peered":"2023-08-09T14:15:28.365408+0000","last_clean":"2023-08-09T14:15:28.365408+0000","last_became_active":"2023-08-09T14:15:27.361611+0000","last_became_peered":"2023-08-09T14:15:27.361611+0000","last_unstale":"2023-08-09T14:15:28.365408+0000","last_undegraded":"2023-08-09T14:15:28.365408+0000","last_fullsized":"2023-08-09T14:15:28.365408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:32.068473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364274+0000","last_change":"2023-08-09T14:15:26.369258+0000","last_active":"2023-08-09T14:15:28.364274+0000","last_peered":"2023-08-09T14:15:28.364274+0000","last_clean":"2023-08-09T14:15:28.364274+0000","last_became_active":"2023-08-09T14:15:26.368961+0000","last_became_peered":"2023-08-09T14:15:26.368961+0000","last_unstale":"2023-08-09T14:15:28.364274+0000","last_undegraded":"2023-08-09T14:15:28.364274+0000","last_fullsized":"2023-08-09T14:15:28.364274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365673+0000","last_change":"2023-08-09T14:15:27.372992+0000","last_active":"2023-08-09T14:15:28.365673+0000","last_peered":"2023-08-09T14:15:28.365673+0000","last_clean":"2023-08-09T14:15:28.365673+0000","last_became_active":"2023-08-09T14:15:27.372751+0000","last_became_peered":"2023-08-09T14:15:27.372751+0000","last_unstale":"2023-08-09T14:15:28.365673+0000","last_undegraded":"2023-08-09T14:15:28.365673+0000","last_fullsized":"2023-08-09T14:15:28.365673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:31.574664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715405+0000","last_change":"2023-08-09T14:15:26.363414+0000","last_active":"2023-08-09T14:15:28.715405+0000","last_peered":"2023-08-09T14:15:28.715405+0000","last_clean":"2023-08-09T14:15:28.715405+0000","last_became_active":"2023-08-09T14:15:26.363094+0000","last_became_peered":"2023-08-09T14:15:26.363094+0000","last_unstale":"2023-08-09T14:15:28.715405+0000","last_undegraded":"2023-08-09T14:15:28.715405+0000","last_fullsized":"2023-08-09T14:15:28.715405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:32.261834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363815+0000","last_change":"2023-08-09T14:15:27.358343+0000","last_active":"2023-08-09T14:15:28.363815+0000","last_peered":"2023-08-09T14:15:28.363815+0000","last_clean":"2023-08-09T14:15:28.363815+0000","last_became_active":"2023-08-09T14:15:27.358044+0000","last_became_peered":"2023-08-09T14:15:27.358044+0000","last_unstale":"2023-08-09T14:15:28.363815+0000","last_undegraded":"2023-08-09T14:15:28.363815+0000","last_fullsized":"2023-08-09T14:15:28.363815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716164+0000","last_change":"2023-08-09T14:15:26.358191+0000","last_active":"2023-08-09T14:15:28.716164+0000","last_peered":"2023-08-09T14:15:28.716164+0000","last_clean":"2023-08-09T14:15:28.716164+0000","last_became_active":"2023-08-09T14:15:26.357725+0000","last_became_peered":"2023-08-09T14:15:26.357725+0000","last_unstale":"2023-08-09T14:15:28.716164+0000","last_undegraded":"2023-08-09T14:15:28.716164+0000","last_fullsized":"2023-08-09T14:15:28.716164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365165+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:15:28.365165+0000","last_peered":"2023-08-09T14:15:28.365165+0000","last_clean":"2023-08-09T14:15:28.365165+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:15:28.365165+0000","last_undegraded":"2023-08-09T14:15:28.365165+0000","last_fullsized":"2023-08-09T14:15:28.365165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:29.070235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715537+0000","last_change":"2023-08-09T14:15:27.370345+0000","last_active":"2023-08-09T14:15:28.715537+0000","last_peered":"2023-08-09T14:15:28.715537+0000","last_clean":"2023-08-09T14:15:28.715537+0000","last_became_active":"2023-08-09T14:15:27.370097+0000","last_became_peered":"2023-08-09T14:15:27.370097+0000","last_unstale":"2023-08-09T14:15:28.715537+0000","last_undegraded":"2023-08-09T14:15:28.715537+0000","last_fullsized":"2023-08-09T14:15:28.715537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715740+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:15:28.715740+0000","last_peered":"2023-08-09T14:15:28.715740+0000","last_clean":"2023-08-09T14:15:28.715740+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:15:28.715740+0000","last_undegraded":"2023-08-09T14:15:28.715740+0000","last_fullsized":"2023-08-09T14:15:28.715740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:49.358632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.912827+0000","last_change":"2023-08-09T14:15:26.362381+0000","last_active":"2023-08-09T14:15:28.912827+0000","last_peered":"2023-08-09T14:15:28.912827+0000","last_clean":"2023-08-09T14:15:28.912827+0000","last_became_active":"2023-08-09T14:15:26.362034+0000","last_became_peered":"2023-08-09T14:15:26.362034+0000","last_unstale":"2023-08-09T14:15:28.912827+0000","last_undegraded":"2023-08-09T14:15:28.912827+0000","last_fullsized":"2023-08-09T14:15:28.912827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365369+0000","last_change":"2023-08-09T14:15:27.364324+0000","last_active":"2023-08-09T14:15:28.365369+0000","last_peered":"2023-08-09T14:15:28.365369+0000","last_clean":"2023-08-09T14:15:28.365369+0000","last_became_active":"2023-08-09T14:15:27.364037+0000","last_became_peered":"2023-08-09T14:15:27.364037+0000","last_unstale":"2023-08-09T14:15:28.365369+0000","last_undegraded":"2023-08-09T14:15:28.365369+0000","last_fullsized":"2023-08-09T14:15:28.365369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363416+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:15:28.363416+0000","last_peered":"2023-08-09T14:15:28.363416+0000","last_clean":"2023-08-09T14:15:28.363416+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:15:28.363416+0000","last_undegraded":"2023-08-09T14:15:28.363416+0000","last_fullsized":"2023-08-09T14:15:28.363416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:16.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364505+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:15:28.364505+0000","last_peered":"2023-08-09T14:15:28.364505+0000","last_clean":"2023-08-09T14:15:28.364505+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:15:28.364505+0000","last_undegraded":"2023-08-09T14:15:28.364505+0000","last_fullsized":"2023-08-09T14:15:28.364505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:25.028342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714831+0000","last_change":"2023-08-09T14:15:26.359463+0000","last_active":"2023-08-09T14:15:28.714831+0000","last_peered":"2023-08-09T14:15:28.714831+0000","last_clean":"2023-08-09T14:15:28.714831+0000","last_became_active":"2023-08-09T14:15:26.359089+0000","last_became_peered":"2023-08-09T14:15:26.359089+0000","last_unstale":"2023-08-09T14:15:28.714831+0000","last_undegraded":"2023-08-09T14:15:28.714831+0000","last_fullsized":"2023-08-09T14:15:28.714831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:21.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715221+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715221+0000","last_peered":"2023-08-09T14:15:28.715221+0000","last_clean":"2023-08-09T14:15:28.715221+0000","last_became_active":"2023-08-09T14:15:27.377030+0000","last_became_peered":"2023-08-09T14:15:27.377030+0000","last_unstale":"2023-08-09T14:15:28.715221+0000","last_undegraded":"2023-08-09T14:15:28.715221+0000","last_fullsized":"2023-08-09T14:15:28.715221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364475+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:15:28.364475+0000","last_peered":"2023-08-09T14:15:28.364475+0000","last_clean":"2023-08-09T14:15:28.364475+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:15:28.364475+0000","last_undegraded":"2023-08-09T14:15:28.364475+0000","last_fullsized":"2023-08-09T14:15:28.364475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:58.636275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363246+0000","last_change":"2023-08-09T14:15:26.370171+0000","last_active":"2023-08-09T14:15:28.363246+0000","last_peered":"2023-08-09T14:15:28.363246+0000","last_clean":"2023-08-09T14:15:28.363246+0000","last_became_active":"2023-08-09T14:15:26.369702+0000","last_became_peered":"2023-08-09T14:15:26.369702+0000","last_unstale":"2023-08-09T14:15:28.363246+0000","last_undegraded":"2023-08-09T14:15:28.363246+0000","last_fullsized":"2023-08-09T14:15:28.363246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:33.713389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363721+0000","last_change":"2023-08-09T14:15:27.365430+0000","last_active":"2023-08-09T14:15:28.363721+0000","last_peered":"2023-08-09T14:15:28.363721+0000","last_clean":"2023-08-09T14:15:28.363721+0000","last_became_active":"2023-08-09T14:15:27.365151+0000","last_became_peered":"2023-08-09T14:15:27.365151+0000","last_unstale":"2023-08-09T14:15:28.363721+0000","last_undegraded":"2023-08-09T14:15:28.363721+0000","last_fullsized":"2023-08-09T14:15:28.363721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363905+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:15:28.363905+0000","last_peered":"2023-08-09T14:15:28.363905+0000","last_clean":"2023-08-09T14:15:28.363905+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.363905+0000","last_undegraded":"2023-08-09T14:15:28.363905+0000","last_fullsized":"2023-08-09T14:15:28.363905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.854209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715456+0000","last_change":"2023-08-09T14:15:26.358773+0000","last_active":"2023-08-09T14:15:28.715456+0000","last_peered":"2023-08-09T14:15:28.715456+0000","last_clean":"2023-08-09T14:15:28.715456+0000","last_became_active":"2023-08-09T14:15:26.358468+0000","last_became_peered":"2023-08-09T14:15:26.358468+0000","last_unstale":"2023-08-09T14:15:28.715456+0000","last_undegraded":"2023-08-09T14:15:28.715456+0000","last_fullsized":"2023-08-09T14:15:28.715456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:44.991430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714808+0000","last_change":"2023-08-09T14:15:27.375825+0000","last_active":"2023-08-09T14:15:28.714808+0000","last_peered":"2023-08-09T14:15:28.714808+0000","last_clean":"2023-08-09T14:15:28.714808+0000","last_became_active":"2023-08-09T14:15:27.375528+0000","last_became_peered":"2023-08-09T14:15:27.375528+0000","last_unstale":"2023-08-09T14:15:28.714808+0000","last_undegraded":"2023-08-09T14:15:28.714808+0000","last_fullsized":"2023-08-09T14:15:28.714808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:30.580011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714894+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:15:28.714894+0000","last_peered":"2023-08-09T14:15:28.714894+0000","last_clean":"2023-08-09T14:15:28.714894+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.714894+0000","last_undegraded":"2023-08-09T14:15:28.714894+0000","last_fullsized":"2023-08-09T14:15:28.714894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:49.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364555+0000","last_change":"2023-08-09T14:15:26.363945+0000","last_active":"2023-08-09T14:15:28.364555+0000","last_peered":"2023-08-09T14:15:28.364555+0000","last_clean":"2023-08-09T14:15:28.364555+0000","last_became_active":"2023-08-09T14:15:26.363660+0000","last_became_peered":"2023-08-09T14:15:26.363660+0000","last_unstale":"2023-08-09T14:15:28.364555+0000","last_undegraded":"2023-08-09T14:15:28.364555+0000","last_fullsized":"2023-08-09T14:15:28.364555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363792+0000","last_change":"2023-08-09T14:15:27.367876+0000","last_active":"2023-08-09T14:15:28.363792+0000","last_peered":"2023-08-09T14:15:28.363792+0000","last_clean":"2023-08-09T14:15:28.363792+0000","last_became_active":"2023-08-09T14:15:27.367423+0000","last_became_peered":"2023-08-09T14:15:27.367423+0000","last_unstale":"2023-08-09T14:15:28.363792+0000","last_undegraded":"2023-08-09T14:15:28.363792+0000","last_fullsized":"2023-08-09T14:15:28.363792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714849+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:15:28.714849+0000","last_peered":"2023-08-09T14:15:28.714849+0000","last_clean":"2023-08-09T14:15:28.714849+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:15:28.714849+0000","last_undegraded":"2023-08-09T14:15:28.714849+0000","last_fullsized":"2023-08-09T14:15:28.714849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:50.502422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363714+0000","last_change":"2023-08-09T14:15:26.369783+0000","last_active":"2023-08-09T14:15:28.363714+0000","last_peered":"2023-08-09T14:15:28.363714+0000","last_clean":"2023-08-09T14:15:28.363714+0000","last_became_active":"2023-08-09T14:15:26.369470+0000","last_became_peered":"2023-08-09T14:15:26.369470+0000","last_unstale":"2023-08-09T14:15:28.363714+0000","last_undegraded":"2023-08-09T14:15:28.363714+0000","last_fullsized":"2023-08-09T14:15:28.363714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:05.002240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715142+0000","last_change":"2023-08-09T14:15:27.369319+0000","last_active":"2023-08-09T14:15:28.715142+0000","last_peered":"2023-08-09T14:15:28.715142+0000","last_clean":"2023-08-09T14:15:28.715142+0000","last_became_active":"2023-08-09T14:15:27.369020+0000","last_became_peered":"2023-08-09T14:15:27.369020+0000","last_unstale":"2023-08-09T14:15:28.715142+0000","last_undegraded":"2023-08-09T14:15:28.715142+0000","last_fullsized":"2023-08-09T14:15:28.715142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715532+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:15:28.715532+0000","last_peered":"2023-08-09T14:15:28.715532+0000","last_clean":"2023-08-09T14:15:28.715532+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:15:28.715532+0000","last_undegraded":"2023-08-09T14:15:28.715532+0000","last_fullsized":"2023-08-09T14:15:28.715532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:38.576973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715315+0000","last_change":"2023-08-09T14:15:26.362755+0000","last_active":"2023-08-09T14:15:28.715315+0000","last_peered":"2023-08-09T14:15:28.715315+0000","last_clean":"2023-08-09T14:15:28.715315+0000","last_became_active":"2023-08-09T14:15:26.362469+0000","last_became_peered":"2023-08-09T14:15:26.362469+0000","last_unstale":"2023-08-09T14:15:28.715315+0000","last_undegraded":"2023-08-09T14:15:28.715315+0000","last_fullsized":"2023-08-09T14:15:28.715315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363514+0000","last_change":"2023-08-09T14:15:27.364616+0000","last_active":"2023-08-09T14:15:28.363514+0000","last_peered":"2023-08-09T14:15:28.363514+0000","last_clean":"2023-08-09T14:15:28.363514+0000","last_became_active":"2023-08-09T14:15:27.364247+0000","last_became_peered":"2023-08-09T14:15:27.364247+0000","last_unstale":"2023-08-09T14:15:28.363514+0000","last_undegraded":"2023-08-09T14:15:28.363514+0000","last_fullsized":"2023-08-09T14:15:28.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714984+0000","last_change":"2023-08-09T14:15:26.358586+0000","last_active":"2023-08-09T14:15:28.714984+0000","last_peered":"2023-08-09T14:15:28.714984+0000","last_clean":"2023-08-09T14:15:28.714984+0000","last_became_active":"2023-08-09T14:15:26.358267+0000","last_became_peered":"2023-08-09T14:15:26.358267+0000","last_unstale":"2023-08-09T14:15:28.714984+0000","last_undegraded":"2023-08-09T14:15:28.714984+0000","last_fullsized":"2023-08-09T14:15:28.714984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:32.171526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714879+0000","last_change":"2023-08-09T14:15:27.373217+0000","last_active":"2023-08-09T14:15:28.714879+0000","last_peered":"2023-08-09T14:15:28.714879+0000","last_clean":"2023-08-09T14:15:28.714879+0000","last_became_active":"2023-08-09T14:15:27.372954+0000","last_became_peered":"2023-08-09T14:15:27.372954+0000","last_unstale":"2023-08-09T14:15:28.714879+0000","last_undegraded":"2023-08-09T14:15:28.714879+0000","last_fullsized":"2023-08-09T14:15:28.714879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:01.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715067+0000","last_change":"2023-08-09T14:15:26.358758+0000","last_active":"2023-08-09T14:15:28.715067+0000","last_peered":"2023-08-09T14:15:28.715067+0000","last_clean":"2023-08-09T14:15:28.715067+0000","last_became_active":"2023-08-09T14:15:26.358393+0000","last_became_peered":"2023-08-09T14:15:26.358393+0000","last_unstale":"2023-08-09T14:15:28.715067+0000","last_undegraded":"2023-08-09T14:15:28.715067+0000","last_fullsized":"2023-08-09T14:15:28.715067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364413+0000","last_change":"2023-08-09T14:15:27.364626+0000","last_active":"2023-08-09T14:15:28.364413+0000","last_peered":"2023-08-09T14:15:28.364413+0000","last_clean":"2023-08-09T14:15:28.364413+0000","last_became_active":"2023-08-09T14:15:27.364351+0000","last_became_peered":"2023-08-09T14:15:27.364351+0000","last_unstale":"2023-08-09T14:15:28.364413+0000","last_undegraded":"2023-08-09T14:15:28.364413+0000","last_fullsized":"2023-08-09T14:15:28.364413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715277+0000","last_change":"2023-08-09T14:15:26.358163+0000","last_active":"2023-08-09T14:15:28.715277+0000","last_peered":"2023-08-09T14:15:28.715277+0000","last_clean":"2023-08-09T14:15:28.715277+0000","last_became_active":"2023-08-09T14:15:26.357889+0000","last_became_peered":"2023-08-09T14:15:26.357889+0000","last_unstale":"2023-08-09T14:15:28.715277+0000","last_undegraded":"2023-08-09T14:15:28.715277+0000","last_fullsized":"2023-08-09T14:15:28.715277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:09.104325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364686+0000","last_change":"2023-08-09T14:15:27.355036+0000","last_active":"2023-08-09T14:15:28.364686+0000","last_peered":"2023-08-09T14:15:28.364686+0000","last_clean":"2023-08-09T14:15:28.364686+0000","last_became_active":"2023-08-09T14:15:27.354292+0000","last_became_peered":"2023-08-09T14:15:27.354292+0000","last_unstale":"2023-08-09T14:15:28.364686+0000","last_undegraded":"2023-08-09T14:15:28.364686+0000","last_fullsized":"2023-08-09T14:15:28.364686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715832+0000","last_change":"2023-08-09T14:15:26.368865+0000","last_active":"2023-08-09T14:15:28.715832+0000","last_peered":"2023-08-09T14:15:28.715832+0000","last_clean":"2023-08-09T14:15:28.715832+0000","last_became_active":"2023-08-09T14:15:26.368589+0000","last_became_peered":"2023-08-09T14:15:26.368589+0000","last_unstale":"2023-08-09T14:15:28.715832+0000","last_undegraded":"2023-08-09T14:15:28.715832+0000","last_fullsized":"2023-08-09T14:15:28.715832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:03.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715545+0000","last_change":"2023-08-09T14:15:27.358450+0000","last_active":"2023-08-09T14:15:28.715545+0000","last_peered":"2023-08-09T14:15:28.715545+0000","last_clean":"2023-08-09T14:15:28.715545+0000","last_became_active":"2023-08-09T14:15:27.358162+0000","last_became_peered":"2023-08-09T14:15:27.358162+0000","last_unstale":"2023-08-09T14:15:28.715545+0000","last_undegraded":"2023-08-09T14:15:28.715545+0000","last_fullsized":"2023-08-09T14:15:28.715545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715668+0000","last_change":"2023-08-09T14:15:26.364373+0000","last_active":"2023-08-09T14:15:28.715668+0000","last_peered":"2023-08-09T14:15:28.715668+0000","last_clean":"2023-08-09T14:15:28.715668+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715668+0000","last_undegraded":"2023-08-09T14:15:28.715668+0000","last_fullsized":"2023-08-09T14:15:28.715668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364113+0000","last_change":"2023-08-09T14:15:27.375813+0000","last_active":"2023-08-09T14:15:28.364113+0000","last_peered":"2023-08-09T14:15:28.364113+0000","last_clean":"2023-08-09T14:15:28.364113+0000","last_became_active":"2023-08-09T14:15:27.375552+0000","last_became_peered":"2023-08-09T14:15:27.375552+0000","last_unstale":"2023-08-09T14:15:28.364113+0000","last_undegraded":"2023-08-09T14:15:28.364113+0000","last_fullsized":"2023-08-09T14:15:28.364113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.367331+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.367033+0000","last_became_peered":"2023-08-09T14:15:27.367033+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:34.718883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715351+0000","last_change":"2023-08-09T14:15:27.369804+0000","last_active":"2023-08-09T14:15:28.715351+0000","last_peered":"2023-08-09T14:15:28.715351+0000","last_clean":"2023-08-09T14:15:28.715351+0000","last_became_active":"2023-08-09T14:15:27.369506+0000","last_became_peered":"2023-08-09T14:15:27.369506+0000","last_unstale":"2023-08-09T14:15:28.715351+0000","last_undegraded":"2023-08-09T14:15:28.715351+0000","last_fullsized":"2023-08-09T14:15:28.715351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364336+0000","last_change":"2023-08-09T14:15:27.374295+0000","last_active":"2023-08-09T14:15:28.364336+0000","last_peered":"2023-08-09T14:15:28.364336+0000","last_clean":"2023-08-09T14:15:28.364336+0000","last_became_active":"2023-08-09T14:15:27.373789+0000","last_became_peered":"2023-08-09T14:15:27.373789+0000","last_unstale":"2023-08-09T14:15:28.364336+0000","last_undegraded":"2023-08-09T14:15:28.364336+0000","last_fullsized":"2023-08-09T14:15:28.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715801+0000","last_change":"2023-08-09T14:15:27.371728+0000","last_active":"2023-08-09T14:15:28.715801+0000","last_peered":"2023-08-09T14:15:28.715801+0000","last_clean":"2023-08-09T14:15:28.715801+0000","last_became_active":"2023-08-09T14:15:27.371196+0000","last_became_peered":"2023-08-09T14:15:27.371196+0000","last_unstale":"2023-08-09T14:15:28.715801+0000","last_undegraded":"2023-08-09T14:15:28.715801+0000","last_fullsized":"2023-08-09T14:15:28.715801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.367662+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.366977+0000","last_became_peered":"2023-08-09T14:15:27.366977+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":78259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":77800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":668627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":77238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:15:36.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:15:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.475+0000 7feaa2d23700 1 Processor -- start 2023-08-09T14:15:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.475+0000 7feaa2d23700 1 -- start start 2023-08-09T14:15:36.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa2d23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 0x7fea9c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa2d23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea9c071fa0 0x7fea9c06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa2d23700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0cf3c0 con 0x7fea9c0cef40 2023-08-09T14:15:36.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa2d23700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c0ca5c0 con 0x7fea9c071fa0 2023-08-09T14:15:36.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa2d23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0cdea0 con 0x7fea9c06b920 2023-08-09T14:15:36.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea9c071fa0 0x7fea9c06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea9c071fa0 0x7fea9c06a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43010/0 (socket says 172.21.15.5:43010) 2023-08-09T14:15:36.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 -- 172.21.15.5:0/3545355060 learned_addr learned my addr 172.21.15.5:0/3545355060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa0abf700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 0x7fea9c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 -- 172.21.15.5:0/3545355060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 msgr2=0x7fea9c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 0x7fea9c0ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 -- 172.21.15.5:0/3545355060 >> v1:172.21.15.101:6789/0 conn(0x7fea9c0cef40 legacy=0x7fea9c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 -- 172.21.15.5:0/3545355060 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0ce460 con 0x7fea9c071fa0 2023-08-09T14:15:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa0abf700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 0x7fea9c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.476+0000 7feaa12c0700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c071fa0 0x7fea9c06a1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea9400d150 tx=0x7fea9400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1adbcf1241369d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7fea9b7fe700 1 -- 172.21.15.5:0/3545355060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94010070 con 0x7fea9c071fa0 2023-08-09T14:15:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7fea9b7fe700 1 -- 172.21.15.5:0/3545355060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400dbb0 con 0x7fea9c071fa0 2023-08-09T14:15:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7fea9b7fe700 1 -- 172.21.15.5:0/3545355060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94016400 con 0x7fea9c071fa0 2023-08-09T14:15:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 -- 172.21.15.5:0/3545355060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c071fa0 msgr2=0x7fea9c06a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c071fa0 0x7fea9c06a1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea9400d150 tx=0x7fea9400d460 comp rx=0 tx=0).stop 2023-08-09T14:15:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 -- 172.21.15.5:0/3545355060 shutdown_connections 2023-08-09T14:15:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c071fa0 0x7fea9c06a1c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 --2- 172.21.15.5:0/3545355060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c06b920 0x7fea9c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 -- 172.21.15.5:0/3545355060 >> 172.21.15.5:0/3545355060 conn(0x7fea9c0cf560 msgr2=0x7fea9c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 -- 172.21.15.5:0/3545355060 shutdown_connections 2023-08-09T14:15:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.477+0000 7feaa2d23700 1 -- 172.21.15.5:0/3545355060 wait complete. 2023-08-09T14:15:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.479+0000 7feaa2d23700 1 Processor -- start 2023-08-09T14:15:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.479+0000 7feaa2d23700 1 -- start start 2023-08-09T14:15:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 0x7fea9c0a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 0x7fea9c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1eff10 con 0x7fea9c06b920 2023-08-09T14:15:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c15a190 con 0x7fea9c071fa0 2023-08-09T14:15:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa2d23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c158780 con 0x7fea9c0cef40 2023-08-09T14:15:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43012/0 (socket says 172.21.15.5:43012) 2023-08-09T14:15:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 -- 172.21.15.5:0/2877257637 learned_addr learned my addr 172.21.15.5:0/2877257637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7fea9bfff700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 0x7fea9c0a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa12c0700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 0x7fea9c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 -- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 msgr2=0x7fea9c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 0x7fea9c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 -- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 msgr2=0x7fea9c0a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 0x7fea9c0a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 -- 172.21.15.5:0/2877257637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9400bd40 con 0x7fea9c06b920 2023-08-09T14:15:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7fea9bfff700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 0x7fea9c0a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa12c0700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 0x7fea9c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.480+0000 7feaa0abf700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea9000e810 tx=0x7fea9000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90004230 con 0x7fea9c06b920 2023-08-09T14:15:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90004390 con 0x7fea9c06b920 2023-08-09T14:15:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c158a60 con 0x7fea9c06b920 2023-08-09T14:15:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900036a0 con 0x7fea9c06b920 2023-08-09T14:15:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c159020 con 0x7fea9c06b920 2023-08-09T14:15:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.481+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c1f0180 con 0x7fea9c06b920 2023-08-09T14:15:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.482+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea90003800 con 0x7fea9c06b920 2023-08-09T14:15:36.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.482+0000 7fea997fa700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 0x7fea8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.483+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea90088040 con 0x7fea9c06b920 2023-08-09T14:15:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.483+0000 7fea9bfff700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 0x7fea8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.483+0000 7fea9bfff700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 0x7fea8006c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea88000f60 tx=0x7fea88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.487+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fea90053730 con 0x7fea9c06b920 2023-08-09T14:15:36.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.686+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea9c0caaf0 con 0x7fea8006a0e0 2023-08-09T14:15:36.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.694+0000 7fea997fa700 1 -- 172.21.15.5:0/2877257637 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286853 (secure 0 0 0) 0x7fea88001450 con 0x7fea8006a0e0 2023-08-09T14:15:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 msgr2=0x7fea8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 0x7fea8006c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea88000f60 tx=0x7fea88009040 comp rx=0 tx=0).stop 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 msgr2=0x7fea9c1f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea9000e810 tx=0x7fea9000ebd0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 shutdown_connections 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fea8006a0e0 0x7fea8006c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fea9c0cef40 0x7fea9c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c06b920 0x7fea9c1f2660 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 --2- 172.21.15.5:0/2877257637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fea9c071fa0 0x7fea9c0a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.697+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 >> 172.21.15.5:0/2877257637 conn(0x7fea9c0cf560 msgr2=0x7fea9c153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.698+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 shutdown_connections 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.698+0000 7feaa2d23700 1 -- 172.21.15.5:0/2877257637 wait complete. 2023-08-09T14:15:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:15:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-09T14:15:35.784129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2880,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2949120,"data_stored":1809406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.435466"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714534+0000","last_change":"2023-08-09T14:15:27.359010+0000","last_active":"2023-08-09T14:15:28.714534+0000","last_peered":"2023-08-09T14:15:28.714534+0000","last_clean":"2023-08-09T14:15:28.714534+0000","last_became_active":"2023-08-09T14:15:27.358323+0000","last_became_peered":"2023-08-09T14:15:27.358323+0000","last_unstale":"2023-08-09T14:15:28.714534+0000","last_undegraded":"2023-08-09T14:15:28.714534+0000","last_fullsized":"2023-08-09T14:15:28.714534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:03.815478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714970+0000","last_change":"2023-08-09T14:15:27.367989+0000","last_active":"2023-08-09T14:15:28.714970+0000","last_peered":"2023-08-09T14:15:28.714970+0000","last_clean":"2023-08-09T14:15:28.714970+0000","last_became_active":"2023-08-09T14:15:27.367673+0000","last_became_peered":"2023-08-09T14:15:27.367673+0000","last_unstale":"2023-08-09T14:15:28.714970+0000","last_undegraded":"2023-08-09T14:15:28.714970+0000","last_fullsized":"2023-08-09T14:15:28.714970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364961+0000","last_change":"2023-08-09T14:15:27.363689+0000","last_active":"2023-08-09T14:15:28.364961+0000","last_peered":"2023-08-09T14:15:28.364961+0000","last_clean":"2023-08-09T14:15:28.364961+0000","last_became_active":"2023-08-09T14:15:27.362860+0000","last_became_peered":"2023-08-09T14:15:27.362860+0000","last_unstale":"2023-08-09T14:15:28.364961+0000","last_undegraded":"2023-08-09T14:15:28.364961+0000","last_fullsized":"2023-08-09T14:15:28.364961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714809+0000","last_change":"2023-08-09T14:15:27.373792+0000","last_active":"2023-08-09T14:15:28.714809+0000","last_peered":"2023-08-09T14:15:28.714809+0000","last_clean":"2023-08-09T14:15:28.714809+0000","last_became_active":"2023-08-09T14:15:27.373509+0000","last_became_peered":"2023-08-09T14:15:27.373509+0000","last_unstale":"2023-08-09T14:15:28.714809+0000","last_undegraded":"2023-08-09T14:15:28.714809+0000","last_fullsized":"2023-08-09T14:15:28.714809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:22.780067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715145+0000","last_change":"2023-08-09T14:15:27.362006+0000","last_active":"2023-08-09T14:15:28.715145+0000","last_peered":"2023-08-09T14:15:28.715145+0000","last_clean":"2023-08-09T14:15:28.715145+0000","last_became_active":"2023-08-09T14:15:27.361703+0000","last_became_peered":"2023-08-09T14:15:27.361703+0000","last_unstale":"2023-08-09T14:15:28.715145+0000","last_undegraded":"2023-08-09T14:15:28.715145+0000","last_fullsized":"2023-08-09T14:15:28.715145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363995+0000","last_change":"2023-08-09T14:15:27.368188+0000","last_active":"2023-08-09T14:15:28.363995+0000","last_peered":"2023-08-09T14:15:28.363995+0000","last_clean":"2023-08-09T14:15:28.363995+0000","last_became_active":"2023-08-09T14:15:27.367964+0000","last_became_peered":"2023-08-09T14:15:27.367964+0000","last_unstale":"2023-08-09T14:15:28.363995+0000","last_undegraded":"2023-08-09T14:15:28.363995+0000","last_fullsized":"2023-08-09T14:15:28.363995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365249+0000","last_change":"2023-08-09T14:15:27.374050+0000","last_active":"2023-08-09T14:15:28.365249+0000","last_peered":"2023-08-09T14:15:28.365249+0000","last_clean":"2023-08-09T14:15:28.365249+0000","last_became_active":"2023-08-09T14:15:27.373773+0000","last_became_peered":"2023-08-09T14:15:27.373773+0000","last_unstale":"2023-08-09T14:15:28.365249+0000","last_undegraded":"2023-08-09T14:15:28.365249+0000","last_fullsized":"2023-08-09T14:15:28.365249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:04.388411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714972+0000","last_change":"2023-08-09T14:15:27.363180+0000","last_active":"2023-08-09T14:15:28.714972+0000","last_peered":"2023-08-09T14:15:28.714972+0000","last_clean":"2023-08-09T14:15:28.714972+0000","last_became_active":"2023-08-09T14:15:27.362900+0000","last_became_peered":"2023-08-09T14:15:27.362900+0000","last_unstale":"2023-08-09T14:15:28.714972+0000","last_undegraded":"2023-08-09T14:15:28.714972+0000","last_fullsized":"2023-08-09T14:15:28.714972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716296+0000","last_change":"2023-08-09T14:15:27.372871+0000","last_active":"2023-08-09T14:15:28.716296+0000","last_peered":"2023-08-09T14:15:28.716296+0000","last_clean":"2023-08-09T14:15:28.716296+0000","last_became_active":"2023-08-09T14:15:27.372498+0000","last_became_peered":"2023-08-09T14:15:27.372498+0000","last_unstale":"2023-08-09T14:15:28.716296+0000","last_undegraded":"2023-08-09T14:15:28.716296+0000","last_fullsized":"2023-08-09T14:15:28.716296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715540+0000","last_change":"2023-08-09T14:15:27.371102+0000","last_active":"2023-08-09T14:15:28.715540+0000","last_peered":"2023-08-09T14:15:28.715540+0000","last_clean":"2023-08-09T14:15:28.715540+0000","last_became_active":"2023-08-09T14:15:27.369324+0000","last_became_peered":"2023-08-09T14:15:27.369324+0000","last_unstale":"2023-08-09T14:15:28.715540+0000","last_undegraded":"2023-08-09T14:15:28.715540+0000","last_fullsized":"2023-08-09T14:15:28.715540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365879+0000","last_change":"2023-08-09T14:15:27.365332+0000","last_active":"2023-08-09T14:15:28.365879+0000","last_peered":"2023-08-09T14:15:28.365879+0000","last_clean":"2023-08-09T14:15:28.365879+0000","last_became_active":"2023-08-09T14:15:27.365006+0000","last_became_peered":"2023-08-09T14:15:27.365006+0000","last_unstale":"2023-08-09T14:15:28.365879+0000","last_undegraded":"2023-08-09T14:15:28.365879+0000","last_fullsized":"2023-08-09T14:15:28.365879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:30.980568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714590+0000","last_change":"2023-08-09T14:15:27.358952+0000","last_active":"2023-08-09T14:15:28.714590+0000","last_peered":"2023-08-09T14:15:28.714590+0000","last_clean":"2023-08-09T14:15:28.714590+0000","last_became_active":"2023-08-09T14:15:27.357896+0000","last_became_peered":"2023-08-09T14:15:27.357896+0000","last_unstale":"2023-08-09T14:15:28.714590+0000","last_undegraded":"2023-08-09T14:15:28.714590+0000","last_fullsized":"2023-08-09T14:15:28.714590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:25.276374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714853+0000","last_change":"2023-08-09T14:15:27.358714+0000","last_active":"2023-08-09T14:15:28.714853+0000","last_peered":"2023-08-09T14:15:28.714853+0000","last_clean":"2023-08-09T14:15:28.714853+0000","last_became_active":"2023-08-09T14:15:27.358414+0000","last_became_peered":"2023-08-09T14:15:27.358414+0000","last_unstale":"2023-08-09T14:15:28.714853+0000","last_undegraded":"2023-08-09T14:15:28.714853+0000","last_fullsized":"2023-08-09T14:15:28.714853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:01.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715151+0000","last_change":"2023-08-09T14:15:27.368320+0000","last_active":"2023-08-09T14:15:28.715151+0000","last_peered":"2023-08-09T14:15:28.715151+0000","last_clean":"2023-08-09T14:15:28.715151+0000","last_became_active":"2023-08-09T14:15:27.368012+0000","last_became_peered":"2023-08-09T14:15:27.368012+0000","last_unstale":"2023-08-09T14:15:28.715151+0000","last_undegraded":"2023-08-09T14:15:28.715151+0000","last_fullsized":"2023-08-09T14:15:28.715151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365423+0000","last_change":"2023-08-09T14:15:27.377127+0000","last_active":"2023-08-09T14:15:28.365423+0000","last_peered":"2023-08-09T14:15:28.365423+0000","last_clean":"2023-08-09T14:15:28.365423+0000","last_became_active":"2023-08-09T14:15:27.376816+0000","last_became_peered":"2023-08-09T14:15:27.376816+0000","last_unstale":"2023-08-09T14:15:28.365423+0000","last_undegraded":"2023-08-09T14:15:28.365423+0000","last_fullsized":"2023-08-09T14:15:28.365423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364162+0000","last_change":"2023-08-09T14:15:27.368513+0000","last_active":"2023-08-09T14:15:28.364162+0000","last_peered":"2023-08-09T14:15:28.364162+0000","last_clean":"2023-08-09T14:15:28.364162+0000","last_became_active":"2023-08-09T14:15:27.368213+0000","last_became_peered":"2023-08-09T14:15:27.368213+0000","last_unstale":"2023-08-09T14:15:28.364162+0000","last_undegraded":"2023-08-09T14:15:28.364162+0000","last_fullsized":"2023-08-09T14:15:28.364162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715429+0000","last_change":"2023-08-09T14:15:27.372568+0000","last_active":"2023-08-09T14:15:28.715429+0000","last_peered":"2023-08-09T14:15:28.715429+0000","last_clean":"2023-08-09T14:15:28.715429+0000","last_became_active":"2023-08-09T14:15:27.372090+0000","last_became_peered":"2023-08-09T14:15:27.372090+0000","last_unstale":"2023-08-09T14:15:28.715429+0000","last_undegraded":"2023-08-09T14:15:28.715429+0000","last_fullsized":"2023-08-09T14:15:28.715429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365588+0000","last_change":"2023-08-09T14:15:27.362581+0000","last_active":"2023-08-09T14:15:28.365588+0000","last_peered":"2023-08-09T14:15:28.365588+0000","last_clean":"2023-08-09T14:15:28.365588+0000","last_became_active":"2023-08-09T14:15:27.362258+0000","last_became_peered":"2023-08-09T14:15:27.362258+0000","last_unstale":"2023-08-09T14:15:28.365588+0000","last_undegraded":"2023-08-09T14:15:28.365588+0000","last_fullsized":"2023-08-09T14:15:28.365588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:41:12.126098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.374336+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.374042+0000","last_became_peered":"2023-08-09T14:15:27.374042+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:59.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365710+0000","last_change":"2023-08-09T14:15:27.374636+0000","last_active":"2023-08-09T14:15:28.365710+0000","last_peered":"2023-08-09T14:15:28.365710+0000","last_clean":"2023-08-09T14:15:28.365710+0000","last_became_active":"2023-08-09T14:15:27.374373+0000","last_became_peered":"2023-08-09T14:15:27.374373+0000","last_unstale":"2023-08-09T14:15:28.365710+0000","last_undegraded":"2023-08-09T14:15:28.365710+0000","last_fullsized":"2023-08-09T14:15:28.365710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:47:45.522434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365339+0000","last_change":"2023-08-09T14:15:27.371398+0000","last_active":"2023-08-09T14:15:28.365339+0000","last_peered":"2023-08-09T14:15:28.365339+0000","last_clean":"2023-08-09T14:15:28.365339+0000","last_became_active":"2023-08-09T14:15:27.371094+0000","last_became_peered":"2023-08-09T14:15:27.371094+0000","last_unstale":"2023-08-09T14:15:28.365339+0000","last_undegraded":"2023-08-09T14:15:28.365339+0000","last_fullsized":"2023-08-09T14:15:28.365339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714891+0000","last_change":"2023-08-09T14:15:27.373020+0000","last_active":"2023-08-09T14:15:28.714891+0000","last_peered":"2023-08-09T14:15:28.714891+0000","last_clean":"2023-08-09T14:15:28.714891+0000","last_became_active":"2023-08-09T14:15:27.371864+0000","last_became_peered":"2023-08-09T14:15:27.371864+0000","last_unstale":"2023-08-09T14:15:28.714891+0000","last_undegraded":"2023-08-09T14:15:28.714891+0000","last_fullsized":"2023-08-09T14:15:28.714891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715197+0000","last_change":"2023-08-09T14:15:27.360056+0000","last_active":"2023-08-09T14:15:28.715197+0000","last_peered":"2023-08-09T14:15:28.715197+0000","last_clean":"2023-08-09T14:15:28.715197+0000","last_became_active":"2023-08-09T14:15:27.359789+0000","last_became_peered":"2023-08-09T14:15:27.359789+0000","last_unstale":"2023-08-09T14:15:28.715197+0000","last_undegraded":"2023-08-09T14:15:28.715197+0000","last_fullsized":"2023-08-09T14:15:28.715197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364182+0000","last_change":"2023-08-09T14:15:27.370713+0000","last_active":"2023-08-09T14:15:28.364182+0000","last_peered":"2023-08-09T14:15:28.364182+0000","last_clean":"2023-08-09T14:15:28.364182+0000","last_became_active":"2023-08-09T14:15:27.370350+0000","last_became_peered":"2023-08-09T14:15:27.370350+0000","last_unstale":"2023-08-09T14:15:28.364182+0000","last_undegraded":"2023-08-09T14:15:28.364182+0000","last_fullsized":"2023-08-09T14:15:28.364182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.376534+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.376246+0000","last_became_peered":"2023-08-09T14:15:27.376246+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363636+0000","last_change":"2023-08-09T14:15:27.371361+0000","last_active":"2023-08-09T14:15:28.363636+0000","last_peered":"2023-08-09T14:15:28.363636+0000","last_clean":"2023-08-09T14:15:28.363636+0000","last_became_active":"2023-08-09T14:15:27.371080+0000","last_became_peered":"2023-08-09T14:15:27.371080+0000","last_unstale":"2023-08-09T14:15:28.363636+0000","last_undegraded":"2023-08-09T14:15:28.363636+0000","last_fullsized":"2023-08-09T14:15:28.363636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715083+0000","last_change":"2023-08-09T14:15:27.368916+0000","last_active":"2023-08-09T14:15:28.715083+0000","last_peered":"2023-08-09T14:15:28.715083+0000","last_clean":"2023-08-09T14:15:28.715083+0000","last_became_active":"2023-08-09T14:15:27.367870+0000","last_became_peered":"2023-08-09T14:15:27.367870+0000","last_unstale":"2023-08-09T14:15:28.715083+0000","last_undegraded":"2023-08-09T14:15:28.715083+0000","last_fullsized":"2023-08-09T14:15:28.715083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:44.606668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364479+0000","last_change":"2023-08-09T14:15:26.362153+0000","last_active":"2023-08-09T14:15:28.364479+0000","last_peered":"2023-08-09T14:15:28.364479+0000","last_clean":"2023-08-09T14:15:28.364479+0000","last_became_active":"2023-08-09T14:15:26.361870+0000","last_became_peered":"2023-08-09T14:15:26.361870+0000","last_unstale":"2023-08-09T14:15:28.364479+0000","last_undegraded":"2023-08-09T14:15:28.364479+0000","last_fullsized":"2023-08-09T14:15:28.364479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715977+0000","last_change":"2023-08-09T14:15:27.365726+0000","last_active":"2023-08-09T14:15:28.715977+0000","last_peered":"2023-08-09T14:15:28.715977+0000","last_clean":"2023-08-09T14:15:28.715977+0000","last_became_active":"2023-08-09T14:15:27.365446+0000","last_became_peered":"2023-08-09T14:15:27.365446+0000","last_unstale":"2023-08-09T14:15:28.715977+0000","last_undegraded":"2023-08-09T14:15:28.715977+0000","last_fullsized":"2023-08-09T14:15:28.715977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363356+0000","last_change":"2023-08-09T14:15:26.366707+0000","last_active":"2023-08-09T14:15:28.363356+0000","last_peered":"2023-08-09T14:15:28.363356+0000","last_clean":"2023-08-09T14:15:28.363356+0000","last_became_active":"2023-08-09T14:15:26.366353+0000","last_became_peered":"2023-08-09T14:15:26.366353+0000","last_unstale":"2023-08-09T14:15:28.363356+0000","last_undegraded":"2023-08-09T14:15:28.363356+0000","last_fullsized":"2023-08-09T14:15:28.363356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:29.574516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715297+0000","last_change":"2023-08-09T14:15:27.368533+0000","last_active":"2023-08-09T14:15:28.715297+0000","last_peered":"2023-08-09T14:15:28.715297+0000","last_clean":"2023-08-09T14:15:28.715297+0000","last_became_active":"2023-08-09T14:15:27.368106+0000","last_became_peered":"2023-08-09T14:15:27.368106+0000","last_unstale":"2023-08-09T14:15:28.715297+0000","last_undegraded":"2023-08-09T14:15:28.715297+0000","last_fullsized":"2023-08-09T14:15:28.715297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715671+0000","last_change":"2023-08-09T14:15:26.363963+0000","last_active":"2023-08-09T14:15:28.715671+0000","last_peered":"2023-08-09T14:15:28.715671+0000","last_clean":"2023-08-09T14:15:28.715671+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715671+0000","last_undegraded":"2023-08-09T14:15:28.715671+0000","last_fullsized":"2023-08-09T14:15:28.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715478+0000","last_change":"2023-08-09T14:15:27.373373+0000","last_active":"2023-08-09T14:15:28.715478+0000","last_peered":"2023-08-09T14:15:28.715478+0000","last_clean":"2023-08-09T14:15:28.715478+0000","last_became_active":"2023-08-09T14:15:27.373052+0000","last_became_peered":"2023-08-09T14:15:27.373052+0000","last_unstale":"2023-08-09T14:15:28.715478+0000","last_undegraded":"2023-08-09T14:15:28.715478+0000","last_fullsized":"2023-08-09T14:15:28.715478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:33.177020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715542+0000","last_change":"2023-08-09T14:15:26.364578+0000","last_active":"2023-08-09T14:15:28.715542+0000","last_peered":"2023-08-09T14:15:28.715542+0000","last_clean":"2023-08-09T14:15:28.715542+0000","last_became_active":"2023-08-09T14:15:26.364070+0000","last_became_peered":"2023-08-09T14:15:26.364070+0000","last_unstale":"2023-08-09T14:15:28.715542+0000","last_undegraded":"2023-08-09T14:15:28.715542+0000","last_fullsized":"2023-08-09T14:15:28.715542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:03.660476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715566+0000","last_change":"2023-08-09T14:15:27.364655+0000","last_active":"2023-08-09T14:15:28.715566+0000","last_peered":"2023-08-09T14:15:28.715566+0000","last_clean":"2023-08-09T14:15:28.715566+0000","last_became_active":"2023-08-09T14:15:27.364316+0000","last_became_peered":"2023-08-09T14:15:27.364316+0000","last_unstale":"2023-08-09T14:15:28.715566+0000","last_undegraded":"2023-08-09T14:15:28.715566+0000","last_fullsized":"2023-08-09T14:15:28.715566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:02.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715462+0000","last_change":"2023-08-09T14:15:26.355952+0000","last_active":"2023-08-09T14:15:28.715462+0000","last_peered":"2023-08-09T14:15:28.715462+0000","last_clean":"2023-08-09T14:15:28.715462+0000","last_became_active":"2023-08-09T14:15:26.355504+0000","last_became_peered":"2023-08-09T14:15:26.355504+0000","last_unstale":"2023-08-09T14:15:28.715462+0000","last_undegraded":"2023-08-09T14:15:28.715462+0000","last_fullsized":"2023-08-09T14:15:28.715462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:16.905292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715749+0000","last_change":"2023-08-09T14:15:27.366627+0000","last_active":"2023-08-09T14:15:28.715749+0000","last_peered":"2023-08-09T14:15:28.715749+0000","last_clean":"2023-08-09T14:15:28.715749+0000","last_became_active":"2023-08-09T14:15:27.366355+0000","last_became_peered":"2023-08-09T14:15:27.366355+0000","last_unstale":"2023-08-09T14:15:28.715749+0000","last_undegraded":"2023-08-09T14:15:28.715749+0000","last_fullsized":"2023-08-09T14:15:28.715749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:31.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365449+0000","last_change":"2023-08-09T14:15:26.369077+0000","last_active":"2023-08-09T14:15:28.365449+0000","last_peered":"2023-08-09T14:15:28.365449+0000","last_clean":"2023-08-09T14:15:28.365449+0000","last_became_active":"2023-08-09T14:15:26.368729+0000","last_became_peered":"2023-08-09T14:15:26.368729+0000","last_unstale":"2023-08-09T14:15:28.365449+0000","last_undegraded":"2023-08-09T14:15:28.365449+0000","last_fullsized":"2023-08-09T14:15:28.365449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:31.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363694+0000","last_change":"2023-08-09T14:15:27.376850+0000","last_active":"2023-08-09T14:15:28.363694+0000","last_peered":"2023-08-09T14:15:28.363694+0000","last_clean":"2023-08-09T14:15:28.363694+0000","last_became_active":"2023-08-09T14:15:27.376373+0000","last_became_peered":"2023-08-09T14:15:27.376373+0000","last_unstale":"2023-08-09T14:15:28.363694+0000","last_undegraded":"2023-08-09T14:15:28.363694+0000","last_fullsized":"2023-08-09T14:15:28.363694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365232+0000","last_change":"2023-08-09T14:15:26.356121+0000","last_active":"2023-08-09T14:15:28.365232+0000","last_peered":"2023-08-09T14:15:28.365232+0000","last_clean":"2023-08-09T14:15:28.365232+0000","last_became_active":"2023-08-09T14:15:26.355766+0000","last_became_peered":"2023-08-09T14:15:26.355766+0000","last_unstale":"2023-08-09T14:15:28.365232+0000","last_undegraded":"2023-08-09T14:15:28.365232+0000","last_fullsized":"2023-08-09T14:15:28.365232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:05.063045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365844+0000","last_change":"2023-08-09T14:15:27.373146+0000","last_active":"2023-08-09T14:15:28.365844+0000","last_peered":"2023-08-09T14:15:28.365844+0000","last_clean":"2023-08-09T14:15:28.365844+0000","last_became_active":"2023-08-09T14:15:27.372860+0000","last_became_peered":"2023-08-09T14:15:27.372860+0000","last_unstale":"2023-08-09T14:15:28.365844+0000","last_undegraded":"2023-08-09T14:15:28.365844+0000","last_fullsized":"2023-08-09T14:15:28.365844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:19:06.218840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365182+0000","last_change":"2023-08-09T14:15:26.359070+0000","last_active":"2023-08-09T14:15:28.365182+0000","last_peered":"2023-08-09T14:15:28.365182+0000","last_clean":"2023-08-09T14:15:28.365182+0000","last_became_active":"2023-08-09T14:15:26.357308+0000","last_became_peered":"2023-08-09T14:15:26.357308+0000","last_unstale":"2023-08-09T14:15:28.365182+0000","last_undegraded":"2023-08-09T14:15:28.365182+0000","last_fullsized":"2023-08-09T14:15:28.365182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715653+0000","last_change":"2023-08-09T14:15:27.373211+0000","last_active":"2023-08-09T14:15:28.715653+0000","last_peered":"2023-08-09T14:15:28.715653+0000","last_clean":"2023-08-09T14:15:28.715653+0000","last_became_active":"2023-08-09T14:15:27.372904+0000","last_became_peered":"2023-08-09T14:15:27.372904+0000","last_unstale":"2023-08-09T14:15:28.715653+0000","last_undegraded":"2023-08-09T14:15:28.715653+0000","last_fullsized":"2023-08-09T14:15:28.715653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714978+0000","last_change":"2023-08-09T14:15:26.365445+0000","last_active":"2023-08-09T14:15:28.714978+0000","last_peered":"2023-08-09T14:15:28.714978+0000","last_clean":"2023-08-09T14:15:28.714978+0000","last_became_active":"2023-08-09T14:15:26.365146+0000","last_became_peered":"2023-08-09T14:15:26.365146+0000","last_unstale":"2023-08-09T14:15:28.714978+0000","last_undegraded":"2023-08-09T14:15:28.714978+0000","last_fullsized":"2023-08-09T14:15:28.714978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715163+0000","last_change":"2023-08-09T14:15:27.368128+0000","last_active":"2023-08-09T14:15:28.715163+0000","last_peered":"2023-08-09T14:15:28.715163+0000","last_clean":"2023-08-09T14:15:28.715163+0000","last_became_active":"2023-08-09T14:15:27.365878+0000","last_became_peered":"2023-08-09T14:15:27.365878+0000","last_unstale":"2023-08-09T14:15:28.715163+0000","last_undegraded":"2023-08-09T14:15:28.715163+0000","last_fullsized":"2023-08-09T14:15:28.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365331+0000","last_change":"2023-08-09T14:15:26.362477+0000","last_active":"2023-08-09T14:15:28.365331+0000","last_peered":"2023-08-09T14:15:28.365331+0000","last_clean":"2023-08-09T14:15:28.365331+0000","last_became_active":"2023-08-09T14:15:26.362201+0000","last_became_peered":"2023-08-09T14:15:26.362201+0000","last_unstale":"2023-08-09T14:15:28.365331+0000","last_undegraded":"2023-08-09T14:15:28.365331+0000","last_fullsized":"2023-08-09T14:15:28.365331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715086+0000","last_change":"2023-08-09T14:15:27.368351+0000","last_active":"2023-08-09T14:15:28.715086+0000","last_peered":"2023-08-09T14:15:28.715086+0000","last_clean":"2023-08-09T14:15:28.715086+0000","last_became_active":"2023-08-09T14:15:27.367354+0000","last_became_peered":"2023-08-09T14:15:27.367354+0000","last_unstale":"2023-08-09T14:15:28.715086+0000","last_undegraded":"2023-08-09T14:15:28.715086+0000","last_fullsized":"2023-08-09T14:15:28.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714566+0000","last_change":"2023-08-09T14:15:26.364067+0000","last_active":"2023-08-09T14:15:28.714566+0000","last_peered":"2023-08-09T14:15:28.714566+0000","last_clean":"2023-08-09T14:15:28.714566+0000","last_became_active":"2023-08-09T14:15:26.363763+0000","last_became_peered":"2023-08-09T14:15:26.363763+0000","last_unstale":"2023-08-09T14:15:28.714566+0000","last_undegraded":"2023-08-09T14:15:28.714566+0000","last_fullsized":"2023-08-09T14:15:28.714566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:13.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716271+0000","last_change":"2023-08-09T14:15:27.367007+0000","last_active":"2023-08-09T14:15:28.716271+0000","last_peered":"2023-08-09T14:15:28.716271+0000","last_clean":"2023-08-09T14:15:28.716271+0000","last_became_active":"2023-08-09T14:15:27.366701+0000","last_became_peered":"2023-08-09T14:15:27.366701+0000","last_unstale":"2023-08-09T14:15:28.716271+0000","last_undegraded":"2023-08-09T14:15:28.716271+0000","last_fullsized":"2023-08-09T14:15:28.716271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:06.068539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364911+0000","last_change":"2023-08-09T14:15:26.358111+0000","last_active":"2023-08-09T14:15:28.364911+0000","last_peered":"2023-08-09T14:15:28.364911+0000","last_clean":"2023-08-09T14:15:28.364911+0000","last_became_active":"2023-08-09T14:15:26.357775+0000","last_became_peered":"2023-08-09T14:15:26.357775+0000","last_unstale":"2023-08-09T14:15:28.364911+0000","last_undegraded":"2023-08-09T14:15:28.364911+0000","last_fullsized":"2023-08-09T14:15:28.364911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:02.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715182+0000","last_change":"2023-08-09T14:15:27.370898+0000","last_active":"2023-08-09T14:15:28.715182+0000","last_peered":"2023-08-09T14:15:28.715182+0000","last_clean":"2023-08-09T14:15:28.715182+0000","last_became_active":"2023-08-09T14:15:27.370605+0000","last_became_peered":"2023-08-09T14:15:27.370605+0000","last_unstale":"2023-08-09T14:15:28.715182+0000","last_undegraded":"2023-08-09T14:15:28.715182+0000","last_fullsized":"2023-08-09T14:15:28.715182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364888+0000","last_change":"2023-08-09T14:15:26.356264+0000","last_active":"2023-08-09T14:15:28.364888+0000","last_peered":"2023-08-09T14:15:28.364888+0000","last_clean":"2023-08-09T14:15:28.364888+0000","last_became_active":"2023-08-09T14:15:26.355974+0000","last_became_peered":"2023-08-09T14:15:26.355974+0000","last_unstale":"2023-08-09T14:15:28.364888+0000","last_undegraded":"2023-08-09T14:15:28.364888+0000","last_fullsized":"2023-08-09T14:15:28.364888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364131+0000","last_change":"2023-08-09T14:15:27.364910+0000","last_active":"2023-08-09T14:15:28.364131+0000","last_peered":"2023-08-09T14:15:28.364131+0000","last_clean":"2023-08-09T14:15:28.364131+0000","last_became_active":"2023-08-09T14:15:27.364633+0000","last_became_peered":"2023-08-09T14:15:27.364633+0000","last_unstale":"2023-08-09T14:15:28.364131+0000","last_undegraded":"2023-08-09T14:15:28.364131+0000","last_fullsized":"2023-08-09T14:15:28.364131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365252+0000","last_change":"2023-08-09T14:15:26.359582+0000","last_active":"2023-08-09T14:15:28.365252+0000","last_peered":"2023-08-09T14:15:28.365252+0000","last_clean":"2023-08-09T14:15:28.365252+0000","last_became_active":"2023-08-09T14:15:26.358709+0000","last_became_peered":"2023-08-09T14:15:26.358709+0000","last_unstale":"2023-08-09T14:15:28.365252+0000","last_undegraded":"2023-08-09T14:15:28.365252+0000","last_fullsized":"2023-08-09T14:15:28.365252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:37.757503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715501+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715501+0000","last_peered":"2023-08-09T14:15:28.715501+0000","last_clean":"2023-08-09T14:15:28.715501+0000","last_became_active":"2023-08-09T14:15:27.376934+0000","last_became_peered":"2023-08-09T14:15:27.376934+0000","last_unstale":"2023-08-09T14:15:28.715501+0000","last_undegraded":"2023-08-09T14:15:28.715501+0000","last_fullsized":"2023-08-09T14:15:28.715501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:42.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715282+0000","last_change":"2023-08-09T14:15:26.361599+0000","last_active":"2023-08-09T14:15:28.715282+0000","last_peered":"2023-08-09T14:15:28.715282+0000","last_clean":"2023-08-09T14:15:28.715282+0000","last_became_active":"2023-08-09T14:15:26.361344+0000","last_became_peered":"2023-08-09T14:15:26.361344+0000","last_unstale":"2023-08-09T14:15:28.715282+0000","last_undegraded":"2023-08-09T14:15:28.715282+0000","last_fullsized":"2023-08-09T14:15:28.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:54.887960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714818+0000","last_change":"2023-08-09T14:15:27.377369+0000","last_active":"2023-08-09T14:15:28.714818+0000","last_peered":"2023-08-09T14:15:28.714818+0000","last_clean":"2023-08-09T14:15:28.714818+0000","last_became_active":"2023-08-09T14:15:27.376969+0000","last_became_peered":"2023-08-09T14:15:27.376969+0000","last_unstale":"2023-08-09T14:15:28.714818+0000","last_undegraded":"2023-08-09T14:15:28.714818+0000","last_fullsized":"2023-08-09T14:15:28.714818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715897+0000","last_change":"2023-08-09T14:15:26.365316+0000","last_active":"2023-08-09T14:15:28.715897+0000","last_peered":"2023-08-09T14:15:28.715897+0000","last_clean":"2023-08-09T14:15:28.715897+0000","last_became_active":"2023-08-09T14:15:26.365027+0000","last_became_peered":"2023-08-09T14:15:26.365027+0000","last_unstale":"2023-08-09T14:15:28.715897+0000","last_undegraded":"2023-08-09T14:15:28.715897+0000","last_fullsized":"2023-08-09T14:15:28.715897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:29.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365111+0000","last_change":"2023-08-09T14:15:27.364606+0000","last_active":"2023-08-09T14:15:28.365111+0000","last_peered":"2023-08-09T14:15:28.365111+0000","last_clean":"2023-08-09T14:15:28.365111+0000","last_became_active":"2023-08-09T14:15:27.364110+0000","last_became_peered":"2023-08-09T14:15:27.364110+0000","last_unstale":"2023-08-09T14:15:28.365111+0000","last_undegraded":"2023-08-09T14:15:28.365111+0000","last_fullsized":"2023-08-09T14:15:28.365111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:12:38.762997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715355+0000","last_change":"2023-08-09T14:15:26.364188+0000","last_active":"2023-08-09T14:15:28.715355+0000","last_peered":"2023-08-09T14:15:28.715355+0000","last_clean":"2023-08-09T14:15:28.715355+0000","last_became_active":"2023-08-09T14:15:26.363813+0000","last_became_peered":"2023-08-09T14:15:26.363813+0000","last_unstale":"2023-08-09T14:15:28.715355+0000","last_undegraded":"2023-08-09T14:15:28.715355+0000","last_fullsized":"2023-08-09T14:15:28.715355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:54.109205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365408+0000","last_change":"2023-08-09T14:15:27.361904+0000","last_active":"2023-08-09T14:15:28.365408+0000","last_peered":"2023-08-09T14:15:28.365408+0000","last_clean":"2023-08-09T14:15:28.365408+0000","last_became_active":"2023-08-09T14:15:27.361611+0000","last_became_peered":"2023-08-09T14:15:27.361611+0000","last_unstale":"2023-08-09T14:15:28.365408+0000","last_undegraded":"2023-08-09T14:15:28.365408+0000","last_fullsized":"2023-08-09T14:15:28.365408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:33:32.068473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364274+0000","last_change":"2023-08-09T14:15:26.369258+0000","last_active":"2023-08-09T14:15:28.364274+0000","last_peered":"2023-08-09T14:15:28.364274+0000","last_clean":"2023-08-09T14:15:28.364274+0000","last_became_active":"2023-08-09T14:15:26.368961+0000","last_became_peered":"2023-08-09T14:15:26.368961+0000","last_unstale":"2023-08-09T14:15:28.364274+0000","last_undegraded":"2023-08-09T14:15:28.364274+0000","last_fullsized":"2023-08-09T14:15:28.364274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365673+0000","last_change":"2023-08-09T14:15:27.372992+0000","last_active":"2023-08-09T14:15:28.365673+0000","last_peered":"2023-08-09T14:15:28.365673+0000","last_clean":"2023-08-09T14:15:28.365673+0000","last_became_active":"2023-08-09T14:15:27.372751+0000","last_became_peered":"2023-08-09T14:15:27.372751+0000","last_unstale":"2023-08-09T14:15:28.365673+0000","last_undegraded":"2023-08-09T14:15:28.365673+0000","last_fullsized":"2023-08-09T14:15:28.365673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:31.574664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715405+0000","last_change":"2023-08-09T14:15:26.363414+0000","last_active":"2023-08-09T14:15:28.715405+0000","last_peered":"2023-08-09T14:15:28.715405+0000","last_clean":"2023-08-09T14:15:28.715405+0000","last_became_active":"2023-08-09T14:15:26.363094+0000","last_became_peered":"2023-08-09T14:15:26.363094+0000","last_unstale":"2023-08-09T14:15:28.715405+0000","last_undegraded":"2023-08-09T14:15:28.715405+0000","last_fullsized":"2023-08-09T14:15:28.715405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:32.261834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363815+0000","last_change":"2023-08-09T14:15:27.358343+0000","last_active":"2023-08-09T14:15:28.363815+0000","last_peered":"2023-08-09T14:15:28.363815+0000","last_clean":"2023-08-09T14:15:28.363815+0000","last_became_active":"2023-08-09T14:15:27.358044+0000","last_became_peered":"2023-08-09T14:15:27.358044+0000","last_unstale":"2023-08-09T14:15:28.363815+0000","last_undegraded":"2023-08-09T14:15:28.363815+0000","last_fullsized":"2023-08-09T14:15:28.363815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.716164+0000","last_change":"2023-08-09T14:15:26.358191+0000","last_active":"2023-08-09T14:15:28.716164+0000","last_peered":"2023-08-09T14:15:28.716164+0000","last_clean":"2023-08-09T14:15:28.716164+0000","last_became_active":"2023-08-09T14:15:26.357725+0000","last_became_peered":"2023-08-09T14:15:26.357725+0000","last_unstale":"2023-08-09T14:15:28.716164+0000","last_undegraded":"2023-08-09T14:15:28.716164+0000","last_fullsized":"2023-08-09T14:15:28.716164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:34.094436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365165+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:15:28.365165+0000","last_peered":"2023-08-09T14:15:28.365165+0000","last_clean":"2023-08-09T14:15:28.365165+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:15:28.365165+0000","last_undegraded":"2023-08-09T14:15:28.365165+0000","last_fullsized":"2023-08-09T14:15:28.365165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:29.070235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715537+0000","last_change":"2023-08-09T14:15:27.370345+0000","last_active":"2023-08-09T14:15:28.715537+0000","last_peered":"2023-08-09T14:15:28.715537+0000","last_clean":"2023-08-09T14:15:28.715537+0000","last_became_active":"2023-08-09T14:15:27.370097+0000","last_became_peered":"2023-08-09T14:15:27.370097+0000","last_unstale":"2023-08-09T14:15:28.715537+0000","last_undegraded":"2023-08-09T14:15:28.715537+0000","last_fullsized":"2023-08-09T14:15:28.715537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715740+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:15:28.715740+0000","last_peered":"2023-08-09T14:15:28.715740+0000","last_clean":"2023-08-09T14:15:28.715740+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:15:28.715740+0000","last_undegraded":"2023-08-09T14:15:28.715740+0000","last_fullsized":"2023-08-09T14:15:28.715740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:49.358632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.912827+0000","last_change":"2023-08-09T14:15:26.362381+0000","last_active":"2023-08-09T14:15:28.912827+0000","last_peered":"2023-08-09T14:15:28.912827+0000","last_clean":"2023-08-09T14:15:28.912827+0000","last_became_active":"2023-08-09T14:15:26.362034+0000","last_became_peered":"2023-08-09T14:15:26.362034+0000","last_unstale":"2023-08-09T14:15:28.912827+0000","last_undegraded":"2023-08-09T14:15:28.912827+0000","last_fullsized":"2023-08-09T14:15:28.912827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.365369+0000","last_change":"2023-08-09T14:15:27.364324+0000","last_active":"2023-08-09T14:15:28.365369+0000","last_peered":"2023-08-09T14:15:28.365369+0000","last_clean":"2023-08-09T14:15:28.365369+0000","last_became_active":"2023-08-09T14:15:27.364037+0000","last_became_peered":"2023-08-09T14:15:27.364037+0000","last_unstale":"2023-08-09T14:15:28.365369+0000","last_undegraded":"2023-08-09T14:15:28.365369+0000","last_fullsized":"2023-08-09T14:15:28.365369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:23:48.531907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363416+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:15:28.363416+0000","last_peered":"2023-08-09T14:15:28.363416+0000","last_clean":"2023-08-09T14:15:28.363416+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:15:28.363416+0000","last_undegraded":"2023-08-09T14:15:28.363416+0000","last_fullsized":"2023-08-09T14:15:28.363416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:16.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364505+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:15:28.364505+0000","last_peered":"2023-08-09T14:15:28.364505+0000","last_clean":"2023-08-09T14:15:28.364505+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:15:28.364505+0000","last_undegraded":"2023-08-09T14:15:28.364505+0000","last_fullsized":"2023-08-09T14:15:28.364505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:25.028342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714831+0000","last_change":"2023-08-09T14:15:26.359463+0000","last_active":"2023-08-09T14:15:28.714831+0000","last_peered":"2023-08-09T14:15:28.714831+0000","last_clean":"2023-08-09T14:15:28.714831+0000","last_became_active":"2023-08-09T14:15:26.359089+0000","last_became_peered":"2023-08-09T14:15:26.359089+0000","last_unstale":"2023-08-09T14:15:28.714831+0000","last_undegraded":"2023-08-09T14:15:28.714831+0000","last_fullsized":"2023-08-09T14:15:28.714831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:21.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715221+0000","last_change":"2023-08-09T14:15:27.377386+0000","last_active":"2023-08-09T14:15:28.715221+0000","last_peered":"2023-08-09T14:15:28.715221+0000","last_clean":"2023-08-09T14:15:28.715221+0000","last_became_active":"2023-08-09T14:15:27.377030+0000","last_became_peered":"2023-08-09T14:15:27.377030+0000","last_unstale":"2023-08-09T14:15:28.715221+0000","last_undegraded":"2023-08-09T14:15:28.715221+0000","last_fullsized":"2023-08-09T14:15:28.715221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:55.893454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364475+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:15:28.364475+0000","last_peered":"2023-08-09T14:15:28.364475+0000","last_clean":"2023-08-09T14:15:28.364475+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:15:28.364475+0000","last_undegraded":"2023-08-09T14:15:28.364475+0000","last_fullsized":"2023-08-09T14:15:28.364475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:58.636275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363246+0000","last_change":"2023-08-09T14:15:26.370171+0000","last_active":"2023-08-09T14:15:28.363246+0000","last_peered":"2023-08-09T14:15:28.363246+0000","last_clean":"2023-08-09T14:15:28.363246+0000","last_became_active":"2023-08-09T14:15:26.369702+0000","last_became_peered":"2023-08-09T14:15:26.369702+0000","last_unstale":"2023-08-09T14:15:28.363246+0000","last_undegraded":"2023-08-09T14:15:28.363246+0000","last_fullsized":"2023-08-09T14:15:28.363246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:33.713389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363721+0000","last_change":"2023-08-09T14:15:27.365430+0000","last_active":"2023-08-09T14:15:28.363721+0000","last_peered":"2023-08-09T14:15:28.363721+0000","last_clean":"2023-08-09T14:15:28.363721+0000","last_became_active":"2023-08-09T14:15:27.365151+0000","last_became_peered":"2023-08-09T14:15:27.365151+0000","last_unstale":"2023-08-09T14:15:28.363721+0000","last_undegraded":"2023-08-09T14:15:28.363721+0000","last_fullsized":"2023-08-09T14:15:28.363721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363905+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:15:28.363905+0000","last_peered":"2023-08-09T14:15:28.363905+0000","last_clean":"2023-08-09T14:15:28.363905+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.363905+0000","last_undegraded":"2023-08-09T14:15:28.363905+0000","last_fullsized":"2023-08-09T14:15:28.363905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.854209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715456+0000","last_change":"2023-08-09T14:15:26.358773+0000","last_active":"2023-08-09T14:15:28.715456+0000","last_peered":"2023-08-09T14:15:28.715456+0000","last_clean":"2023-08-09T14:15:28.715456+0000","last_became_active":"2023-08-09T14:15:26.358468+0000","last_became_peered":"2023-08-09T14:15:26.358468+0000","last_unstale":"2023-08-09T14:15:28.715456+0000","last_undegraded":"2023-08-09T14:15:28.715456+0000","last_fullsized":"2023-08-09T14:15:28.715456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:44.991430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714808+0000","last_change":"2023-08-09T14:15:27.375825+0000","last_active":"2023-08-09T14:15:28.714808+0000","last_peered":"2023-08-09T14:15:28.714808+0000","last_clean":"2023-08-09T14:15:28.714808+0000","last_became_active":"2023-08-09T14:15:27.375528+0000","last_became_peered":"2023-08-09T14:15:27.375528+0000","last_unstale":"2023-08-09T14:15:28.714808+0000","last_undegraded":"2023-08-09T14:15:28.714808+0000","last_fullsized":"2023-08-09T14:15:28.714808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:30.580011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714894+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:15:28.714894+0000","last_peered":"2023-08-09T14:15:28.714894+0000","last_clean":"2023-08-09T14:15:28.714894+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:15:28.714894+0000","last_undegraded":"2023-08-09T14:15:28.714894+0000","last_fullsized":"2023-08-09T14:15:28.714894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:49.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364555+0000","last_change":"2023-08-09T14:15:26.363945+0000","last_active":"2023-08-09T14:15:28.364555+0000","last_peered":"2023-08-09T14:15:28.364555+0000","last_clean":"2023-08-09T14:15:28.364555+0000","last_became_active":"2023-08-09T14:15:26.363660+0000","last_became_peered":"2023-08-09T14:15:26.363660+0000","last_unstale":"2023-08-09T14:15:28.364555+0000","last_undegraded":"2023-08-09T14:15:28.364555+0000","last_fullsized":"2023-08-09T14:15:28.364555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:05:54.382833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363792+0000","last_change":"2023-08-09T14:15:27.367876+0000","last_active":"2023-08-09T14:15:28.363792+0000","last_peered":"2023-08-09T14:15:28.363792+0000","last_clean":"2023-08-09T14:15:28.363792+0000","last_became_active":"2023-08-09T14:15:27.367423+0000","last_became_peered":"2023-08-09T14:15:27.367423+0000","last_unstale":"2023-08-09T14:15:28.363792+0000","last_undegraded":"2023-08-09T14:15:28.363792+0000","last_fullsized":"2023-08-09T14:15:28.363792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714849+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:15:28.714849+0000","last_peered":"2023-08-09T14:15:28.714849+0000","last_clean":"2023-08-09T14:15:28.714849+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:15:28.714849+0000","last_undegraded":"2023-08-09T14:15:28.714849+0000","last_fullsized":"2023-08-09T14:15:28.714849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:50.502422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363714+0000","last_change":"2023-08-09T14:15:26.369783+0000","last_active":"2023-08-09T14:15:28.363714+0000","last_peered":"2023-08-09T14:15:28.363714+0000","last_clean":"2023-08-09T14:15:28.363714+0000","last_became_active":"2023-08-09T14:15:26.369470+0000","last_became_peered":"2023-08-09T14:15:26.369470+0000","last_unstale":"2023-08-09T14:15:28.363714+0000","last_undegraded":"2023-08-09T14:15:28.363714+0000","last_fullsized":"2023-08-09T14:15:28.363714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:05.002240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715142+0000","last_change":"2023-08-09T14:15:27.369319+0000","last_active":"2023-08-09T14:15:28.715142+0000","last_peered":"2023-08-09T14:15:28.715142+0000","last_clean":"2023-08-09T14:15:28.715142+0000","last_became_active":"2023-08-09T14:15:27.369020+0000","last_became_peered":"2023-08-09T14:15:27.369020+0000","last_unstale":"2023-08-09T14:15:28.715142+0000","last_undegraded":"2023-08-09T14:15:28.715142+0000","last_fullsized":"2023-08-09T14:15:28.715142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:45.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715532+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:15:28.715532+0000","last_peered":"2023-08-09T14:15:28.715532+0000","last_clean":"2023-08-09T14:15:28.715532+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:15:28.715532+0000","last_undegraded":"2023-08-09T14:15:28.715532+0000","last_fullsized":"2023-08-09T14:15:28.715532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:38.576973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715315+0000","last_change":"2023-08-09T14:15:26.362755+0000","last_active":"2023-08-09T14:15:28.715315+0000","last_peered":"2023-08-09T14:15:28.715315+0000","last_clean":"2023-08-09T14:15:28.715315+0000","last_became_active":"2023-08-09T14:15:26.362469+0000","last_became_peered":"2023-08-09T14:15:26.362469+0000","last_unstale":"2023-08-09T14:15:28.715315+0000","last_undegraded":"2023-08-09T14:15:28.715315+0000","last_fullsized":"2023-08-09T14:15:28.715315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:01.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363514+0000","last_change":"2023-08-09T14:15:27.364616+0000","last_active":"2023-08-09T14:15:28.363514+0000","last_peered":"2023-08-09T14:15:28.363514+0000","last_clean":"2023-08-09T14:15:28.363514+0000","last_became_active":"2023-08-09T14:15:27.364247+0000","last_became_peered":"2023-08-09T14:15:27.364247+0000","last_unstale":"2023-08-09T14:15:28.363514+0000","last_undegraded":"2023-08-09T14:15:28.363514+0000","last_fullsized":"2023-08-09T14:15:28.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:56.532117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714984+0000","last_change":"2023-08-09T14:15:26.358586+0000","last_active":"2023-08-09T14:15:28.714984+0000","last_peered":"2023-08-09T14:15:28.714984+0000","last_clean":"2023-08-09T14:15:28.714984+0000","last_became_active":"2023-08-09T14:15:26.358267+0000","last_became_peered":"2023-08-09T14:15:26.358267+0000","last_unstale":"2023-08-09T14:15:28.714984+0000","last_undegraded":"2023-08-09T14:15:28.714984+0000","last_fullsized":"2023-08-09T14:15:28.714984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:32.171526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714879+0000","last_change":"2023-08-09T14:15:27.373217+0000","last_active":"2023-08-09T14:15:28.714879+0000","last_peered":"2023-08-09T14:15:28.714879+0000","last_clean":"2023-08-09T14:15:28.714879+0000","last_became_active":"2023-08-09T14:15:27.372954+0000","last_became_peered":"2023-08-09T14:15:27.372954+0000","last_unstale":"2023-08-09T14:15:28.714879+0000","last_undegraded":"2023-08-09T14:15:28.714879+0000","last_fullsized":"2023-08-09T14:15:28.714879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:01.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715067+0000","last_change":"2023-08-09T14:15:26.358758+0000","last_active":"2023-08-09T14:15:28.715067+0000","last_peered":"2023-08-09T14:15:28.715067+0000","last_clean":"2023-08-09T14:15:28.715067+0000","last_became_active":"2023-08-09T14:15:26.358393+0000","last_became_peered":"2023-08-09T14:15:26.358393+0000","last_unstale":"2023-08-09T14:15:28.715067+0000","last_undegraded":"2023-08-09T14:15:28.715067+0000","last_fullsized":"2023-08-09T14:15:28.715067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:41.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364413+0000","last_change":"2023-08-09T14:15:27.364626+0000","last_active":"2023-08-09T14:15:28.364413+0000","last_peered":"2023-08-09T14:15:28.364413+0000","last_clean":"2023-08-09T14:15:28.364413+0000","last_became_active":"2023-08-09T14:15:27.364351+0000","last_became_peered":"2023-08-09T14:15:27.364351+0000","last_unstale":"2023-08-09T14:15:28.364413+0000","last_undegraded":"2023-08-09T14:15:28.364413+0000","last_fullsized":"2023-08-09T14:15:28.364413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:04.665970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715277+0000","last_change":"2023-08-09T14:15:26.358163+0000","last_active":"2023-08-09T14:15:28.715277+0000","last_peered":"2023-08-09T14:15:28.715277+0000","last_clean":"2023-08-09T14:15:28.715277+0000","last_became_active":"2023-08-09T14:15:26.357889+0000","last_became_peered":"2023-08-09T14:15:26.357889+0000","last_unstale":"2023-08-09T14:15:28.715277+0000","last_undegraded":"2023-08-09T14:15:28.715277+0000","last_fullsized":"2023-08-09T14:15:28.715277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:09.104325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364686+0000","last_change":"2023-08-09T14:15:27.355036+0000","last_active":"2023-08-09T14:15:28.364686+0000","last_peered":"2023-08-09T14:15:28.364686+0000","last_clean":"2023-08-09T14:15:28.364686+0000","last_became_active":"2023-08-09T14:15:27.354292+0000","last_became_peered":"2023-08-09T14:15:27.354292+0000","last_unstale":"2023-08-09T14:15:28.364686+0000","last_undegraded":"2023-08-09T14:15:28.364686+0000","last_fullsized":"2023-08-09T14:15:28.364686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715832+0000","last_change":"2023-08-09T14:15:26.368865+0000","last_active":"2023-08-09T14:15:28.715832+0000","last_peered":"2023-08-09T14:15:28.715832+0000","last_clean":"2023-08-09T14:15:28.715832+0000","last_became_active":"2023-08-09T14:15:26.368589+0000","last_became_peered":"2023-08-09T14:15:26.368589+0000","last_unstale":"2023-08-09T14:15:28.715832+0000","last_undegraded":"2023-08-09T14:15:28.715832+0000","last_fullsized":"2023-08-09T14:15:28.715832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:03.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715545+0000","last_change":"2023-08-09T14:15:27.358450+0000","last_active":"2023-08-09T14:15:28.715545+0000","last_peered":"2023-08-09T14:15:28.715545+0000","last_clean":"2023-08-09T14:15:28.715545+0000","last_became_active":"2023-08-09T14:15:27.358162+0000","last_became_peered":"2023-08-09T14:15:27.358162+0000","last_unstale":"2023-08-09T14:15:28.715545+0000","last_undegraded":"2023-08-09T14:15:28.715545+0000","last_fullsized":"2023-08-09T14:15:28.715545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:10.109820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715668+0000","last_change":"2023-08-09T14:15:26.364373+0000","last_active":"2023-08-09T14:15:28.715668+0000","last_peered":"2023-08-09T14:15:28.715668+0000","last_clean":"2023-08-09T14:15:28.715668+0000","last_became_active":"2023-08-09T14:15:26.363699+0000","last_became_peered":"2023-08-09T14:15:26.363699+0000","last_unstale":"2023-08-09T14:15:28.715668+0000","last_undegraded":"2023-08-09T14:15:28.715668+0000","last_fullsized":"2023-08-09T14:15:28.715668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:25.332442+0000","last_clean_scrub_stamp":"2023-08-09T14:15:25.332442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:30.052543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364113+0000","last_change":"2023-08-09T14:15:27.375813+0000","last_active":"2023-08-09T14:15:28.364113+0000","last_peered":"2023-08-09T14:15:28.364113+0000","last_clean":"2023-08-09T14:15:28.364113+0000","last_became_active":"2023-08-09T14:15:27.375552+0000","last_became_peered":"2023-08-09T14:15:27.375552+0000","last_unstale":"2023-08-09T14:15:28.364113+0000","last_undegraded":"2023-08-09T14:15:28.364113+0000","last_fullsized":"2023-08-09T14:15:28.364113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:33.267328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.714641+0000","last_change":"2023-08-09T14:15:27.367331+0000","last_active":"2023-08-09T14:15:28.714641+0000","last_peered":"2023-08-09T14:15:28.714641+0000","last_clean":"2023-08-09T14:15:28.714641+0000","last_became_active":"2023-08-09T14:15:27.367033+0000","last_became_peered":"2023-08-09T14:15:27.367033+0000","last_unstale":"2023-08-09T14:15:28.714641+0000","last_undegraded":"2023-08-09T14:15:28.714641+0000","last_fullsized":"2023-08-09T14:15:28.714641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:34.718883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715351+0000","last_change":"2023-08-09T14:15:27.369804+0000","last_active":"2023-08-09T14:15:28.715351+0000","last_peered":"2023-08-09T14:15:28.715351+0000","last_clean":"2023-08-09T14:15:28.715351+0000","last_became_active":"2023-08-09T14:15:27.369506+0000","last_became_peered":"2023-08-09T14:15:27.369506+0000","last_unstale":"2023-08-09T14:15:28.715351+0000","last_undegraded":"2023-08-09T14:15:28.715351+0000","last_fullsized":"2023-08-09T14:15:28.715351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:06.007734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.364336+0000","last_change":"2023-08-09T14:15:27.374295+0000","last_active":"2023-08-09T14:15:28.364336+0000","last_peered":"2023-08-09T14:15:28.364336+0000","last_clean":"2023-08-09T14:15:28.364336+0000","last_became_active":"2023-08-09T14:15:27.373789+0000","last_became_peered":"2023-08-09T14:15:27.373789+0000","last_unstale":"2023-08-09T14:15:28.364336+0000","last_undegraded":"2023-08-09T14:15:28.364336+0000","last_fullsized":"2023-08-09T14:15:28.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:17.910787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.715801+0000","last_change":"2023-08-09T14:15:27.371728+0000","last_active":"2023-08-09T14:15:28.715801+0000","last_peered":"2023-08-09T14:15:28.715801+0000","last_clean":"2023-08-09T14:15:28.715801+0000","last_became_active":"2023-08-09T14:15:27.371196+0000","last_became_peered":"2023-08-09T14:15:27.371196+0000","last_unstale":"2023-08-09T14:15:28.715801+0000","last_undegraded":"2023-08-09T14:15:28.715801+0000","last_fullsized":"2023-08-09T14:15:28.715801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:01:03.604407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-09T14:15:28.363642+0000","last_change":"2023-08-09T14:15:27.367662+0000","last_active":"2023-08-09T14:15:28.363642+0000","last_peered":"2023-08-09T14:15:28.363642+0000","last_clean":"2023-08-09T14:15:28.363642+0000","last_became_active":"2023-08-09T14:15:27.366977+0000","last_became_peered":"2023-08-09T14:15:27.366977+0000","last_unstale":"2023-08-09T14:15:28.363642+0000","last_undegraded":"2023-08-09T14:15:28.363642+0000","last_fullsized":"2023-08-09T14:15:28.363642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:26.337937+0000","last_clean_scrub_stamp":"2023-08-09T14:15:26.337937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:55.114699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":78259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":77800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":668627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":77238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:15:36.722 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-09T14:15:36.723 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-09T14:15:36.723 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-09T14:15:36.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-09T14:15:36.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.875+0000 7f69e46f1700 1 Processor -- start 2023-08-09T14:15:36.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.875+0000 7f69e46f1700 1 -- start start 2023-08-09T14:15:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.876+0000 7f69e46f1700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f69dc1606a0 0x7f69dc161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.876+0000 7f69e46f1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc06e2a0 con 0x7f69dc070c80 2023-08-09T14:15:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.876+0000 7f69e46f1700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0b2630 con 0x7f69dc06b6a0 2023-08-09T14:15:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.876+0000 7f69e46f1700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc0717e0 con 0x7f69dc1606a0 2023-08-09T14:15:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e2c8e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69dc070c80 0x7f69dc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56440/0 (socket says 172.21.15.5:56440) 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e2c8e700 1 -- 172.21.15.5:0/2317336208 learned_addr learned my addr 172.21.15.5:0/2317336208 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e248d700 1 --2- 172.21.15.5:0/2317336208 >> v2:172.21.15.101:3300/0 conn(0x7f69dc1606a0 0x7f69dc161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782717059 0 0) 0x7f69dc06e2a0 con 0x7f69dc070c80 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c80035b0 con 0x7f69dc070c80 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708339993 0 0) 0x7f69c80035b0 con 0x7f69dc070c80 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 >> v2:172.21.15.101:3300/0 conn(0x7f69dc1606a0 msgr2=0x7f69dc161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 --2- 172.21.15.5:0/2317336208 >> v2:172.21.15.101:3300/0 conn(0x7f69dc1606a0 0x7f69dc161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 >> v1:172.21.15.101:6789/0 conn(0x7f69dc06b6a0 legacy=0x7f69dc070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0b2b80 con 0x7f69dc070c80 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f69d40019f0 con 0x7f69dc070c80 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 >> v1:172.21.15.5:6789/0 conn(0x7f69dc070c80 legacy=0x7f69dc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69c8003a00 0x7f69c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69c8004850 0x7f69c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c800c080 con 0x7f69c8005210 2023-08-09T14:15:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c800c1f0 con 0x7f69c8004850 2023-08-09T14:15:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c800c3b0 con 0x7f69c8003a00 2023-08-09T14:15:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e2c8e700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e1c8c700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69c8004850 0x7f69c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.877+0000 7f69e248d700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69c8003a00 0x7f69c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 -- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69c8003a00 msgr2=0x7f69c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69c8003a00 0x7f69c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 -- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69c8004850 msgr2=0x7f69c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69c8004850 0x7f69c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 -- 172.21.15.5:0/2317336208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80035b0 con 0x7f69c8005210 2023-08-09T14:15:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e1c8c700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69c8004850 0x7f69c8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 -- 172.21.15.5:0/2317336208 reap_dead start 2023-08-09T14:15:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e2c8e700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69c800ba10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69d400a830 tx=0x7f69c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e832981a027905d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400a2f0 con 0x7f69c8005210 2023-08-09T14:15:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4012600 con 0x7f69c8005210 2023-08-09T14:15:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e148b700 1 -- 172.21.15.5:0/2317336208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40129b0 con 0x7f69c8005210 2023-08-09T14:15:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e46f1700 1 -- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 msgr2=0x7f69c800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.878+0000 7f69e46f1700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69c800ba10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69d400a830 tx=0x7f69c8005880 comp rx=0 tx=0).stop 2023-08-09T14:15:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.879+0000 7f69e46f1700 1 -- 172.21.15.5:0/2317336208 shutdown_connections 2023-08-09T14:15:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.879+0000 7f69e46f1700 1 --2- 172.21.15.5:0/2317336208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69c800ba10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.879+0000 7f69e46f1700 1 -- 172.21.15.5:0/2317336208 >> 172.21.15.5:0/2317336208 conn(0x7f69dc0cf540 msgr2=0x7f69dc0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.879+0000 7f69e46f1700 1 -- 172.21.15.5:0/2317336208 shutdown_connections 2023-08-09T14:15:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.879+0000 7f69e46f1700 1 -- 172.21.15.5:0/2317336208 wait complete. 2023-08-09T14:15:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.880+0000 7f69e46f1700 1 Processor -- start 2023-08-09T14:15:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.880+0000 7f69e46f1700 1 -- start start 2023-08-09T14:15:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.880+0000 7f69e46f1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.880+0000 7f69e46f1700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69dc152e10 0x7f69dc0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.880+0000 7f69e46f1700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69dc151c20 0x7f69dc0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e46f1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc153f10 con 0x7f69c8005210 2023-08-09T14:15:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e46f1700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc153390 con 0x7f69dc151c20 2023-08-09T14:15:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e46f1700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc153670 con 0x7f69dc152e10 2023-08-09T14:15:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43032/0 (socket says 172.21.15.5:43032) 2023-08-09T14:15:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 -- 172.21.15.5:0/3845755121 learned_addr learned my addr 172.21.15.5:0/3845755121 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e2c8e700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69dc151c20 0x7f69dc0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e1c8c700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69dc152e10 0x7f69dc0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 -- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69dc152e10 msgr2=0x7f69dc0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69dc152e10 0x7f69dc0c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 -- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69dc151c20 msgr2=0x7f69dc0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69dc151c20 0x7f69dc0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 -- 172.21.15.5:0/3845755121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc153950 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e248d700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69d80119a0 tx=0x7f69d8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800f940 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800faa0 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc153c30 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800fe30 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.881+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc1e5a90 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.882+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc074600 con 0x7f69c8005210 2023-08-09T14:15:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.883+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f69d8014440 con 0x7f69c8005210 2023-08-09T14:15:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.883+0000 7f69ceffd700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 0x7f69c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.883+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69d8088bf0 con 0x7f69c8005210 2023-08-09T14:15:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.883+0000 7f69e1c8c700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 0x7f69c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.884+0000 7f69e1c8c700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 0x7f69c006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69dc1e79d0 tx=0x7f69d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:36.887+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f69d8057e00 con 0x7f69c8005210 2023-08-09T14:15:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.130+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f69dc152690 con 0x7f69c8005210 2023-08-09T14:15:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.131+0000 7f69ceffd700 1 -- 172.21.15.5:0/3845755121 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f69d8057990 con 0x7f69c8005210 2023-08-09T14:15:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:37.134 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-09T14:15:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 msgr2=0x7f69c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 0x7f69c006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69dc1e79d0 tx=0x7f69d0009040 comp rx=0 tx=0).stop 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 msgr2=0x7f69dc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69d80119a0 tx=0x7f69d8011d60 comp rx=0 tx=0).stop 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 shutdown_connections 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f69c006a0e0 0x7f69c006c5a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f69dc151c20 0x7f69dc0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c8005210 0x7f69dc1528d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 --2- 172.21.15.5:0/3845755121 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f69dc152e10 0x7f69dc0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 >> 172.21.15.5:0/3845755121 conn(0x7f69dc0cf540 msgr2=0x7f69dc0b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 shutdown_connections 2023-08-09T14:15:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.133+0000 7f69e46f1700 1 -- 172.21.15.5:0/3845755121 wait complete. 2023-08-09T14:15:37.147 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-09T14:15:37.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.269+0000 7f639e984700 1 Processor -- start 2023-08-09T14:15:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.269+0000 7f639e984700 1 -- start start 2023-08-09T14:15:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639e984700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 0x7f63980cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639e984700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 0x7f639806d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639e984700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639806e850 con 0x7f639806a1c0 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639e984700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639806aad0 con 0x7f639815d400 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639e984700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980cf7b0 con 0x7f639806a640 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f63977fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f639806a1c0 0x7f639806cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56456/0 (socket says 172.21.15.5:56456) 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f63977fe700 1 -- 172.21.15.5:0/71807129 learned_addr learned my addr 172.21.15.5:0/71807129 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f639cf21700 1 --2- 172.21.15.5:0/71807129 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 0x7f639806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.270+0000 7f6397fff700 1 --2- 172.21.15.5:0/71807129 >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 0x7f63980cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6396ffd700 1 -- 172.21.15.5:0/71807129 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657081844 0 0) 0x7f639806e850 con 0x7f639806a1c0 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6396ffd700 1 -- 172.21.15.5:0/71807129 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63800035b0 con 0x7f639806a1c0 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f639cf21700 1 -- 172.21.15.5:0/71807129 >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 msgr2=0x7f63980cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f639cf21700 1 --2- 172.21.15.5:0/71807129 >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 0x7f63980cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f639cf21700 1 -- 172.21.15.5:0/71807129 >> v1:172.21.15.5:6789/0 conn(0x7f639806a1c0 legacy=0x7f639806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f639cf21700 1 -- 172.21.15.5:0/71807129 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980cfa90 con 0x7f639806a640 2023-08-09T14:15:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6397fff700 1 --2- 172.21.15.5:0/71807129 >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 0x7f63980cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f639cf21700 1 --2- 172.21.15.5:0/71807129 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 0x7f639806d460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6390009d90 tx=0x7f639000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841459039770d889 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6396ffd700 1 -- 172.21.15.5:0/71807129 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639000e070 con 0x7f639806a640 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6396ffd700 1 -- 172.21.15.5:0/71807129 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639000bb20 con 0x7f639806a640 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.271+0000 7f6396ffd700 1 -- 172.21.15.5:0/71807129 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390012430 con 0x7f639806a640 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 -- 172.21.15.5:0/71807129 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 msgr2=0x7f639806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 --2- 172.21.15.5:0/71807129 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 0x7f639806d460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6390009d90 tx=0x7f639000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 -- 172.21.15.5:0/71807129 shutdown_connections 2023-08-09T14:15:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 --2- 172.21.15.5:0/71807129 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639806a640 0x7f639806d460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 --2- 172.21.15.5:0/71807129 >> v2:172.21.15.101:3300/0 conn(0x7f639815d400 0x7f63980cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 -- 172.21.15.5:0/71807129 >> 172.21.15.5:0/71807129 conn(0x7f63980b1900 msgr2=0x7f63980b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 -- 172.21.15.5:0/71807129 shutdown_connections 2023-08-09T14:15:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.272+0000 7f639e984700 1 -- 172.21.15.5:0/71807129 wait complete. 2023-08-09T14:15:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.273+0000 7f639e984700 1 Processor -- start 2023-08-09T14:15:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 -- start start 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 0x7f63980c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639815d400 0x7f63980c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980c5b20 con 0x7f639806a1c0 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981f2950 con 0x7f639806a640 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f639e984700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63981f6370 con 0x7f639815d400 2023-08-09T14:15:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.274+0000 7f6397fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43044/0 (socket says 172.21.15.5:43044) 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 -- 172.21.15.5:0/2813876568 learned_addr learned my addr 172.21.15.5:0/2813876568 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f639cf21700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639815d400 0x7f63980c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f63977fe700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 0x7f63980c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 -- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639815d400 msgr2=0x7f63980c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639815d400 0x7f63980c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 -- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 msgr2=0x7f63980c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 0x7f63980c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 -- 172.21.15.5:0/2813876568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094a0 con 0x7f639806a1c0 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f63977fe700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 0x7f63980c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6397fff700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f638800ebe0 tx=0x7f638800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388009800 con 0x7f639806a1c0 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800c8b0 con 0x7f639806a1c0 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800cc20 con 0x7f639806a1c0 2023-08-09T14:15:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6390009a70 con 0x7f639806a1c0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.275+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63981f6930 con 0x7f639806a1c0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.276+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63981f2c20 con 0x7f639806a1c0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.276+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f638800cd80 con 0x7f639806a1c0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.277+0000 7f6394ff9700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.277+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6388088610 con 0x7f639806a1c0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.277+0000 7f63977fe700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.277+0000 7f63977fe700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 0x7f638406c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63980c9f90 tx=0x7f638c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.281+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6388057790 con 0x7f639806a1c0 2023-08-09T14:15:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.482+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6398074600 con 0x7f639806a1c0 2023-08-09T14:15:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.483+0000 7f6394ff9700 1 -- 172.21.15.5:0/2813876568 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f6388057320 con 0x7f639806a1c0 2023-08-09T14:15:37.486 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:37.486 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 msgr2=0x7f638406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 0x7f638406c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63980c9f90 tx=0x7f638c009040 comp rx=0 tx=0).stop 2023-08-09T14:15:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 msgr2=0x7f63980c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f638800ebe0 tx=0x7f638800eef0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 shutdown_connections 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f639815d400 0x7f63980c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f639806a1c0 0x7f63980c5d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 --2- 172.21.15.5:0/2813876568 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f639806a640 0x7f63980c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 >> 172.21.15.5:0/2813876568 conn(0x7f63980b1900 msgr2=0x7f639815a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 shutdown_connections 2023-08-09T14:15:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.485+0000 7f639e984700 1 -- 172.21.15.5:0/2813876568 wait complete. 2023-08-09T14:15:37.500 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:37.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.626+0000 7f30d0134700 1 Processor -- start 2023-08-09T14:15:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.626+0000 7f30d0134700 1 -- start start 2023-08-09T14:15:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30d0134700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f30c80cd1c0 0x7f30c80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30d0134700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30d0134700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c806ab50 con 0x7f30c815d3a0 2023-08-09T14:15:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30d0134700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80cd6c0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30d0134700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80715a0 con 0x7f30c806a1c0 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30cded0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30c815d3a0 0x7f30c80cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56468/0 (socket says 172.21.15.5:56468) 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30cded0700 1 -- 172.21.15.5:0/4198154721 learned_addr learned my addr 172.21.15.5:0/4198154721 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30ce6d1700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/4198154721 >> v2:172.21.15.101:3300/0 conn(0x7f30c80cd1c0 0x7f30c80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907286624 0 0) 0x7f30bc001110 con 0x7f30c815d3a0 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.627+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b40035b0 con 0x7f30c815d3a0 2023-08-09T14:15:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30cd6cf700 1 -- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 msgr2=0x7f30c806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703186262 0 0) 0x7f30b40035b0 con 0x7f30c815d3a0 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30cd6cf700 1 -- 172.21.15.5:0/4198154721 >> v1:172.21.15.5:6789/0 conn(0x7f30c815d3a0 legacy=0x7f30c80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30cd6cf700 1 -- 172.21.15.5:0/4198154721 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80712a0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30ce6d1700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c80cd1c0 0x7f30c80af2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009840 tx=0x7f30c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=115d612f4db9b9b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc001800 con 0x7f30c80cd1c0 2023-08-09T14:15:37.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c4004030 con 0x7f30c80cd1c0 2023-08-09T14:15:37.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30ccece700 1 -- 172.21.15.5:0/4198154721 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c40043a0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30d0134700 1 -- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c80cd1c0 msgr2=0x7f30c80af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30d0134700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c80cd1c0 0x7f30c80af2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009840 tx=0x7f30c4009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30d0134700 1 -- 172.21.15.5:0/4198154721 shutdown_connections 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30d0134700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.628+0000 7f30d0134700 1 --2- 172.21.15.5:0/4198154721 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c80cd1c0 0x7f30c80af2c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.629+0000 7f30d0134700 1 -- 172.21.15.5:0/4198154721 >> 172.21.15.5:0/4198154721 conn(0x7f30c80b1970 msgr2=0x7f30c80b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.629+0000 7f30d0134700 1 -- 172.21.15.5:0/4198154721 shutdown_connections 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.629+0000 7f30d0134700 1 -- 172.21.15.5:0/4198154721 wait complete. 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.630+0000 7f30d0134700 1 Processor -- start 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.630+0000 7f30d0134700 1 -- start start 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.630+0000 7f30d0134700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.630+0000 7f30d0134700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.630+0000 7f30d0134700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c815d3a0 0x7f30c8151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30d0134700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c815fd30 con 0x7f30c80cd1c0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30d0134700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80b5110 con 0x7f30c815d3a0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30d0134700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80b2bf0 con 0x7f30c806a1c0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43060/0 (socket says 172.21.15.5:43060) 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 -- 172.21.15.5:0/3031710565 learned_addr learned my addr 172.21.15.5:0/3031710565 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cded0700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30ce6d1700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c815d3a0 0x7f30c8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 -- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 msgr2=0x7f30c815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 -- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c815d3a0 msgr2=0x7f30c8151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c815d3a0 0x7f30c8151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 -- 172.21.15.5:0/3031710565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009a70 con 0x7f30c80cd1c0 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30cd6cf700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30c40090b0 tx=0x7f30c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004570 con 0x7f30c80cd1c0 2023-08-09T14:15:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c401f070 con 0x7f30c80cd1c0 2023-08-09T14:15:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40094a0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4011870 con 0x7f30c80cd1c0 2023-08-09T14:15:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.631+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c80b5620 con 0x7f30c80cd1c0 2023-08-09T14:15:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.632+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c80b2d80 con 0x7f30c80cd1c0 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.633+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f30c40119d0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.633+0000 7f30ba7fc700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 0x7f30ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.633+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30c4021070 con 0x7f30c80cd1c0 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.634+0000 7f30cded0700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 0x7f30ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.634+0000 7f30cded0700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 0x7f30ac06c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc007a00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.637+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f30c4055af0 con 0x7f30c80cd1c0 2023-08-09T14:15:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.839+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30c8074600 con 0x7f30c80cd1c0 2023-08-09T14:15:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.840+0000 7f30ba7fc700 1 -- 172.21.15.5:0/3031710565 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30c4059110 con 0x7f30c80cd1c0 2023-08-09T14:15:37.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 msgr2=0x7f30ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 0x7f30ac06c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc007a00 comp rx=0 tx=0).stop 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 msgr2=0x7f30c80b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30c40090b0 tx=0x7f30c4004750 comp rx=0 tx=0).stop 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 shutdown_connections 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f30ac06a0e0 0x7f30ac06c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f30c815d3a0 0x7f30c8151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f30c806a1c0 0x7f30c815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 --2- 172.21.15.5:0/3031710565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c80cd1c0 0x7f30c80b4bd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 >> 172.21.15.5:0/3031710565 conn(0x7f30c80b1970 msgr2=0x7f30c80ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 shutdown_connections 2023-08-09T14:15:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.842+0000 7f30d0134700 1 -- 172.21.15.5:0/3031710565 wait complete. 2023-08-09T14:15:37.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:37.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.983+0000 7ffa71281700 1 Processor -- start 2023-08-09T14:15:37.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.983+0000 7ffa71281700 1 -- start start 2023-08-09T14:15:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa71281700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c160c90 0x7ffa6c0d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa71281700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 0x7ffa6c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa71281700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0b40b0 con 0x7ffa6c0cfd50 2023-08-09T14:15:37.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa71281700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0ce7a0 con 0x7ffa6c160c90 2023-08-09T14:15:37.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa71281700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b48c0 con 0x7ffa6c0d0130 2023-08-09T14:15:37.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c160c90 0x7ffa6c0d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa6c0cfd50 0x7ffa6c160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56482/0 (socket says 172.21.15.5:56482) 2023-08-09T14:15:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c160c90 0x7ffa6c0d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43068/0 (socket says 172.21.15.5:43068) 2023-08-09T14:15:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6affd700 1 -- 172.21.15.5:0/3456795747 learned_addr learned my addr 172.21.15.5:0/3456795747 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6b7fe700 1 --2- 172.21.15.5:0/3456795747 >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 0x7ffa6c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/3456795747 >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 msgr2=0x7ffa6c0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 --2- 172.21.15.5:0/3456795747 >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 0x7ffa6c0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/3456795747 >> v1:172.21.15.5:6789/0 conn(0x7ffa6c0cfd50 legacy=0x7ffa6c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/3456795747 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0cf180 con 0x7ffa6c160c90 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6b7fe700 1 --2- 172.21.15.5:0/3456795747 >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 0x7ffa6c0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa6a7fc700 1 --2- 172.21.15.5:0/3456795747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c160c90 0x7ffa6c0d3c10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cd7d0 tx=0x7ffa5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a518d997f08a647a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa69ffb700 1 -- 172.21.15.5:0/3456795747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c011830 con 0x7ffa6c160c90 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa69ffb700 1 -- 172.21.15.5:0/3456795747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c011990 con 0x7ffa6c160c90 2023-08-09T14:15:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.984+0000 7ffa69ffb700 1 -- 172.21.15.5:0/3456795747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c011d20 con 0x7ffa6c160c90 2023-08-09T14:15:37.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 -- 172.21.15.5:0/3456795747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c160c90 msgr2=0x7ffa6c0d3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:37.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 --2- 172.21.15.5:0/3456795747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c160c90 0x7ffa6c0d3c10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cd7d0 tx=0x7ffa5c009b20 comp rx=0 tx=0).stop 2023-08-09T14:15:37.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 -- 172.21.15.5:0/3456795747 shutdown_connections 2023-08-09T14:15:37.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 --2- 172.21.15.5:0/3456795747 >> v2:172.21.15.101:3300/0 conn(0x7ffa6c0d0130 0x7ffa6c0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 --2- 172.21.15.5:0/3456795747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c160c90 0x7ffa6c0d3c10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 -- 172.21.15.5:0/3456795747 >> 172.21.15.5:0/3456795747 conn(0x7ffa6c0d30f0 msgr2=0x7ffa6c0d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 -- 172.21.15.5:0/3456795747 shutdown_connections 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.985+0000 7ffa71281700 1 -- 172.21.15.5:0/3456795747 wait complete. 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.987+0000 7ffa71281700 1 Processor -- start 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.987+0000 7ffa71281700 1 -- start start 2023-08-09T14:15:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0d0130 0x7ffa6c1f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c160c90 0x7ffa6c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c09e6b0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b0ec0 con 0x7ffa6c0d0130 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b11a0 con 0x7ffa6c160c90 2023-08-09T14:15:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43072/0 (socket says 172.21.15.5:43072) 2023-08-09T14:15:38.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 -- 172.21.15.5:0/232677780 learned_addr learned my addr 172.21.15.5:0/232677780 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:38.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 -- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c160c90 msgr2=0x7ffa6c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c160c90 0x7ffa6c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 -- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0d0130 msgr2=0x7ffa6c1f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0d0130 0x7ffa6c1f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 -- 172.21.15.5:0/232677780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0094a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa6affd700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c480 tx=0x7ffa6000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60005d70 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa600070d0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0b1480 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007440 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.988+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c1f2ea0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.989+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0b19a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.990+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa600075a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.990+0000 7ffa537fe700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 0x7ffa5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.990+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa600879c0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.991+0000 7ffa6a7fc700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 0x7ffa5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.991+0000 7ffa6a7fc700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 0x7ffa5806c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b8d40 tx=0x7ffa5c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:37.995+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ffa6c0b19a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.193+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa6c0b19a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.193+0000 7ffa537fe700 1 -- 172.21.15.5:0/232677780 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa6c0b19a0 con 0x7ffa6c0cfd50 2023-08-09T14:15:38.196 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 msgr2=0x7ffa5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 0x7ffa5806c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b8d40 tx=0x7ffa5c010000 comp rx=0 tx=0).stop 2023-08-09T14:15:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 msgr2=0x7ffa6c0a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c480 tx=0x7ffa6000c840 comp rx=0 tx=0).stop 2023-08-09T14:15:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 shutdown_connections 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5806a0e0 0x7ffa5806c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c160c90 0x7ffa6c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c0cfd50 0x7ffa6c0a0ac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 --2- 172.21.15.5:0/232677780 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0d0130 0x7ffa6c1f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 >> 172.21.15.5:0/232677780 conn(0x7ffa6c0d30f0 msgr2=0x7ffa6c15e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 shutdown_connections 2023-08-09T14:15:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.195+0000 7ffa71281700 1 -- 172.21.15.5:0/232677780 wait complete. 2023-08-09T14:15:38.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.335+0000 7f47d0944700 1 Processor -- start 2023-08-09T14:15:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.335+0000 7f47d0944700 1 -- start start 2023-08-09T14:15:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.336+0000 7f47d0944700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 0x7f47cc0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.336+0000 7f47d0944700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47cc06a1c0 0x7f47cc06a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.336+0000 7f47d0944700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0715a0 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.336+0000 7f47d0944700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0cd6c0 con 0x7f47cc06a1c0 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.336+0000 7f47d0944700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc06ab30 con 0x7f47cc15d3a0 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47cc06a1c0 0x7f47cc06a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47cc06a1c0 0x7f47cc06a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43084/0 (socket says 172.21.15.5:43084) 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 -- 172.21.15.5:0/1743962857 learned_addr learned my addr 172.21.15.5:0/1743962857 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47ca59c700 1 --2- 172.21.15.5:0/1743962857 >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 0x7f47cc0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 -- 172.21.15.5:0/1743962857 >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 msgr2=0x7f47cc0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 --2- 172.21.15.5:0/1743962857 >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 0x7f47cc0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 -- 172.21.15.5:0/1743962857 >> v1:172.21.15.101:6789/0 conn(0x7f47cc0cd1c0 legacy=0x7f47cc0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 -- 172.21.15.5:0/1743962857 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0712a0 con 0x7f47cc06a1c0 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47ca59c700 1 --2- 172.21.15.5:0/1743962857 >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 0x7f47cc0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47cad9d700 1 --2- 172.21.15.5:0/1743962857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc06a1c0 0x7f47cc06a5f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47cc06c900 tx=0x7f47c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cfcb04d0f6aef1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47c959a700 1 -- 172.21.15.5:0/1743962857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400e070 con 0x7f47cc06a1c0 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47c959a700 1 -- 172.21.15.5:0/1743962857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4003a20 con 0x7f47cc06a1c0 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.337+0000 7f47c959a700 1 -- 172.21.15.5:0/1743962857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4003dd0 con 0x7f47cc06a1c0 2023-08-09T14:15:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 -- 172.21.15.5:0/1743962857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc06a1c0 msgr2=0x7f47cc06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 --2- 172.21.15.5:0/1743962857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc06a1c0 0x7f47cc06a5f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47cc06c900 tx=0x7f47c400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 -- 172.21.15.5:0/1743962857 shutdown_connections 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 --2- 172.21.15.5:0/1743962857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc06a1c0 0x7f47cc06a5f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 --2- 172.21.15.5:0/1743962857 >> v2:172.21.15.101:3300/0 conn(0x7f47cc15d3a0 0x7f47cc0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 -- 172.21.15.5:0/1743962857 >> 172.21.15.5:0/1743962857 conn(0x7f47cc0b1970 msgr2=0x7f47cc0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 -- 172.21.15.5:0/1743962857 shutdown_connections 2023-08-09T14:15:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.338+0000 7f47d0944700 1 -- 172.21.15.5:0/1743962857 wait complete. 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.339+0000 7f47d0944700 1 Processor -- start 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.339+0000 7f47d0944700 1 -- start start 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47cc06a1c0 0x7f47cc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47cc15d3a0 0x7f47cc158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc15f280 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b4d20 con 0x7f47cc15d3a0 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47d0944700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b5000 con 0x7f47cc06a1c0 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43088/0 (socket says 172.21.15.5:43088) 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 -- 172.21.15.5:0/269672033 learned_addr learned my addr 172.21.15.5:0/269672033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47ca59c700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47cc06a1c0 0x7f47cc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47cad9d700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47cc15d3a0 0x7f47cc158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 -- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47cc06a1c0 msgr2=0x7f47cc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47cc06a1c0 0x7f47cc156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 -- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47cc15d3a0 msgr2=0x7f47cc158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.340+0000 7f47c9d9b700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47cc15d3a0 0x7f47cc158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47c9d9b700 1 -- 172.21.15.5:0/269672033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009b30 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47c9d9b700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c4a0 tx=0x7f47bc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0054e0 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc003680 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc0b52e0 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003a10 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.341+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc156b70 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.342+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0b5800 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.342+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47bc003b70 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.343+0000 7f47baffd700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 0x7f47ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.343+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47bc0876a0 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.343+0000 7f47ca59c700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 0x7f47ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.343+0000 7f47ca59c700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 0x7f47ac06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47c0006fd0 tx=0x7f47c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.347+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f47bc052d10 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.548+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47cc074600 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.548+0000 7f47baffd700 1 -- 172.21.15.5:0/269672033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47bc056330 con 0x7f47cc0cd1c0 2023-08-09T14:15:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 msgr2=0x7f47ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 0x7f47ac06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47c0006fd0 tx=0x7f47c0008040 comp rx=0 tx=0).stop 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 msgr2=0x7f47cc15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c4a0 tx=0x7f47bc00c7b0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 shutdown_connections 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f47ac06a0e0 0x7f47ac06c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47cc15d3a0 0x7f47cc158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47cc06a1c0 0x7f47cc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 --2- 172.21.15.5:0/269672033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47cc0cd1c0 0x7f47cc15e850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 >> 172.21.15.5:0/269672033 conn(0x7f47cc0b1970 msgr2=0x7f47cc0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 shutdown_connections 2023-08-09T14:15:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.550+0000 7f47d0944700 1 -- 172.21.15.5:0/269672033 wait complete. 2023-08-09T14:15:38.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:38.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.690+0000 7f2620167700 1 Processor -- start 2023-08-09T14:15:38.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.690+0000 7f2620167700 1 -- start start 2023-08-09T14:15:38.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f2620167700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 0x7f261806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f2620167700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f26180b0420 0x7f26180d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f2620167700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261806bce0 con 0x7f26180ccd40 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f2620167700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261806cb50 con 0x7f26180b0420 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f2620167700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261806ccf0 con 0x7f26180cc960 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261df03700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 0x7f261806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261e704700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f26180b0420 0x7f26180d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261d702700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f26180ccd40 0x7f2618160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:37858/0 (socket says 172.21.15.5:37858) 2023-08-09T14:15:38.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261d702700 1 -- 172.21.15.5:0/1786469278 learned_addr learned my addr 172.21.15.5:0/1786469278 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261df03700 1 -- 172.21.15.5:0/1786469278 >> v2:172.21.15.101:3300/0 conn(0x7f26180b0420 msgr2=0x7f26180d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261cf01700 1 -- 172.21.15.5:0/1786469278 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263276681 0 0) 0x7f261806bce0 con 0x7f26180ccd40 2023-08-09T14:15:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261df03700 1 --2- 172.21.15.5:0/1786469278 >> v2:172.21.15.101:3300/0 conn(0x7f26180b0420 0x7f26180d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261df03700 1 -- 172.21.15.5:0/1786469278 >> v1:172.21.15.101:6789/0 conn(0x7f26180ccd40 legacy=0x7f2618160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.691+0000 7f261df03700 1 -- 172.21.15.5:0/1786469278 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261806c210 con 0x7f26180cc960 2023-08-09T14:15:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f261df03700 1 --2- 172.21.15.5:0/1786469278 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 0x7f261806c610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2614009840 tx=0x7f2614009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31c2191cb4f6d66 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f261cf01700 1 -- 172.21.15.5:0/1786469278 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614011830 con 0x7f26180cc960 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f261cf01700 1 -- 172.21.15.5:0/1786469278 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614011990 con 0x7f26180cc960 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f261cf01700 1 -- 172.21.15.5:0/1786469278 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614011d20 con 0x7f26180cc960 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 -- 172.21.15.5:0/1786469278 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 msgr2=0x7f261806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 --2- 172.21.15.5:0/1786469278 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 0x7f261806c610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2614009840 tx=0x7f2614009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 -- 172.21.15.5:0/1786469278 shutdown_connections 2023-08-09T14:15:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 --2- 172.21.15.5:0/1786469278 >> v2:172.21.15.101:3300/0 conn(0x7f26180b0420 0x7f26180d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 --2- 172.21.15.5:0/1786469278 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180cc960 0x7f261806c610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 -- 172.21.15.5:0/1786469278 >> 172.21.15.5:0/1786469278 conn(0x7f261806dec0 msgr2=0x7f261806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 -- 172.21.15.5:0/1786469278 shutdown_connections 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.692+0000 7f2620167700 1 -- 172.21.15.5:0/1786469278 wait complete. 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.693+0000 7f2620167700 1 Processor -- start 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 -- start start 2023-08-09T14:15:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26180cc960 0x7f261814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180ccd40 0x7f26180c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180ca320 con 0x7f26180b0420 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261814ef30 con 0x7f26180cc960 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f2620167700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c7ac0 con 0x7f26180ccd40 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f261df03700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f261df03700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43100/0 (socket says 172.21.15.5:43100) 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f261df03700 1 -- 172.21.15.5:0/2325853303 learned_addr learned my addr 172.21.15.5:0/2325853303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f261d702700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26180cc960 0x7f261814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.694+0000 7f261e704700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180ccd40 0x7f26180c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 -- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180ccd40 msgr2=0x7f26180c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180ccd40 0x7f26180c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 -- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26180cc960 msgr2=0x7f261814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26180cc960 0x7f261814e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 -- 172.21.15.5:0/2325853303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140094a0 con 0x7f26180b0420 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f261df03700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2614009fd0 tx=0x7f2614004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614004550 con 0x7f26180b0420 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261401e070 con 0x7f26180b0420 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26180c99f0 con 0x7f26180b0420 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140038e0 con 0x7f26180b0420 2023-08-09T14:15:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.695+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26180c9fb0 con 0x7f26180b0420 2023-08-09T14:15:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.696+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2618074600 con 0x7f26180b0420 2023-08-09T14:15:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.696+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2614003a40 con 0x7f26180b0420 2023-08-09T14:15:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.697+0000 7f260e7fc700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 0x7f25fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.697+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2614089490 con 0x7f26180b0420 2023-08-09T14:15:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.697+0000 7f261d702700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 0x7f25fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.697+0000 7f261d702700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 0x7f25fc06c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2608007b10 tx=0x7f2608007a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.701+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2614054b90 con 0x7f26180b0420 2023-08-09T14:15:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.904+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f261806fe90 con 0x7f26180b0420 2023-08-09T14:15:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.904+0000 7f260e7fc700 1 -- 172.21.15.5:0/2325853303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26140581b0 con 0x7f26180b0420 2023-08-09T14:15:38.907 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 msgr2=0x7f25fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 0x7f25fc06c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2608007b10 tx=0x7f2608007a60 comp rx=0 tx=0).stop 2023-08-09T14:15:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 msgr2=0x7f2618151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2614009fd0 tx=0x7f2614004750 comp rx=0 tx=0).stop 2023-08-09T14:15:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 shutdown_connections 2023-08-09T14:15:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f25fc06a0e0 0x7f25fc06c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26180ccd40 0x7f26180c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26180b0420 0x7f2618151db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 --2- 172.21.15.5:0/2325853303 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26180cc960 0x7f261814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 >> 172.21.15.5:0/2325853303 conn(0x7f261806dec0 msgr2=0x7f26180d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 shutdown_connections 2023-08-09T14:15:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:38.906+0000 7f2620167700 1 -- 172.21.15.5:0/2325853303 wait complete. 2023-08-09T14:15:38.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:15:39.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.043+0000 7ff5dde4f700 1 Processor -- start 2023-08-09T14:15:39.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.043+0000 7ff5dde4f700 1 -- start start 2023-08-09T14:15:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5dde4f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7ff5d80cefd0 0x7ff5d815df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5dde4f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80aec20 con 0x7ff5d815db90 2023-08-09T14:15:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5dde4f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80cb0c0 con 0x7ff5d815e4b0 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5dde4f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d80cb660 con 0x7ff5d80cefd0 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5d77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5d815db90 0x7ff5d806b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56524/0 (socket says 172.21.15.5:56524) 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.044+0000 7ff5d77fe700 1 -- 172.21.15.5:0/778583105 learned_addr learned my addr 172.21.15.5:0/778583105 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d6ffd700 1 --2- 172.21.15.5:0/778583105 >> v2:172.21.15.101:3300/0 conn(0x7ff5d80cefd0 0x7ff5d815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839844242 0 0) 0x7ff5d80aec20 con 0x7ff5d815db90 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c40035b0 con 0x7ff5d815db90 2023-08-09T14:15:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260019119 0 0) 0x7ff5d80cb0c0 con 0x7ff5d815e4b0 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d80aec20 con 0x7ff5d815e4b0 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220961500 0 0) 0x7ff5c40035b0 con 0x7ff5d815db90 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/778583105 >> v1:172.21.15.101:6789/0 conn(0x7ff5d815e4b0 legacy=0x7ff5d8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/778583105 >> v1:172.21.15.5:6789/0 conn(0x7ff5d815db90 legacy=0x7ff5d806b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/778583105 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80cb380 con 0x7ff5d80cefd0 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d6ffd700 1 --2- 172.21.15.5:0/778583105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815df70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009840 tx=0x7ff5c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4988b1203427e546 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8001670 con 0x7ff5d80cefd0 2023-08-09T14:15:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c0004030 con 0x7ff5d80cefd0 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.045+0000 7ff5d67fc700 1 -- 172.21.15.5:0/778583105 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00043c0 con 0x7ff5d80cefd0 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 -- 172.21.15.5:0/778583105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 msgr2=0x7ff5d815df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/778583105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815df70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009840 tx=0x7ff5c0009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 -- 172.21.15.5:0/778583105 shutdown_connections 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/778583105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815df70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 -- 172.21.15.5:0/778583105 >> 172.21.15.5:0/778583105 conn(0x7ff5d80cf560 msgr2=0x7ff5d80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 -- 172.21.15.5:0/778583105 shutdown_connections 2023-08-09T14:15:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.046+0000 7ff5dde4f700 1 -- 172.21.15.5:0/778583105 wait complete. 2023-08-09T14:15:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.047+0000 7ff5dde4f700 1 Processor -- start 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.047+0000 7ff5dde4f700 1 -- start start 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff5d815e4b0 0x7ff5d8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d815b6e0 con 0x7ff5d815db90 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8156590 con 0x7ff5d80cefd0 2023-08-09T14:15:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5dde4f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d815aa60 con 0x7ff5d815e4b0 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43116/0 (socket says 172.21.15.5:43116) 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/758236039 learned_addr learned my addr 172.21.15.5:0/758236039 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d77fe700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d7fff700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff5d815e4b0 0x7ff5d8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff5d815e4b0 msgr2=0x7ff5d8155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff5d815e4b0 0x7ff5d8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 msgr2=0x7ff5d815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.048+0000 7ff5d6ffd700 1 -- 172.21.15.5:0/758236039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00094a0 con 0x7ff5d815db90 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5d6ffd700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000a010 tx=0x7ff5c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0003d70 con 0x7ff5d815db90 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c001f070 con 0x7ff5d815db90 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0011870 con 0x7ff5d815db90 2023-08-09T14:15:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d815ad40 con 0x7ff5d815db90 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.049+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d815b300 con 0x7ff5d815db90 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.050+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8066650 con 0x7ff5d815db90 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.050+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5c0021030 con 0x7ff5d815db90 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.051+0000 7ff5cffff700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 0x7ff5b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.051+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5c0089830 con 0x7ff5d815db90 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.051+0000 7ff5d77fe700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 0x7ff5b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.051+0000 7ff5d77fe700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 0x7ff5b806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000fd0 tx=0x7ff5c80014b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.055+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff5c00550d0 con 0x7ff5d815db90 2023-08-09T14:15:39.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.298+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d815b820 con 0x7ff5d815db90 2023-08-09T14:15:39.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.299+0000 7ff5cffff700 1 -- 172.21.15.5:0/758236039 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7ff5d815b820 con 0x7ff5d815db90 2023-08-09T14:15:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:39.303 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:15:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 msgr2=0x7ff5b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 0x7ff5b806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000fd0 tx=0x7ff5c80014b0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 msgr2=0x7ff5d815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000a010 tx=0x7ff5c0004750 comp rx=0 tx=0).stop 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 shutdown_connections 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff5b806a0e0 0x7ff5b806c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff5d815e4b0 0x7ff5d8155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff5d80cefd0 0x7ff5d815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 --2- 172.21.15.5:0/758236039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d815db90 0x7ff5d815a350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 >> 172.21.15.5:0/758236039 conn(0x7ff5d80cf560 msgr2=0x7ff5d80c3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 shutdown_connections 2023-08-09T14:15:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.301+0000 7ff5dde4f700 1 -- 172.21.15.5:0/758236039 wait complete. 2023-08-09T14:15:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:15:39.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.437+0000 7f79d9b9a700 1 Processor -- start 2023-08-09T14:15:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.437+0000 7f79d9b9a700 1 -- start start 2023-08-09T14:15:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d9b9a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f79d415e470 0x7f79d40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d9b9a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79d4160de0 0x7f79d41611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d9b9a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d4161700 con 0x7f79d40cd130 2023-08-09T14:15:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d9b9a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40cf3e0 con 0x7f79d4160de0 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d9b9a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40ce3e0 con 0x7f79d415e470 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79d4160de0 0x7f79d41611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79d4160de0 0x7f79d41611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43126/0 (socket says 172.21.15.5:43126) 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d3fff700 1 -- 172.21.15.5:0/289101800 learned_addr learned my addr 172.21.15.5:0/289101800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.438+0000 7f79d2ffd700 1 --2- 172.21.15.5:0/289101800 >> v2:172.21.15.101:3300/0 conn(0x7f79d415e470 0x7f79d40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d3fff700 1 -- 172.21.15.5:0/289101800 >> v2:172.21.15.101:3300/0 conn(0x7f79d415e470 msgr2=0x7f79d40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d3fff700 1 --2- 172.21.15.5:0/289101800 >> v2:172.21.15.101:3300/0 conn(0x7f79d415e470 0x7f79d40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d3fff700 1 -- 172.21.15.5:0/289101800 >> v1:172.21.15.101:6789/0 conn(0x7f79d40cd130 legacy=0x7f79d40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d3fff700 1 -- 172.21.15.5:0/289101800 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4161930 con 0x7f79d4160de0 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d3fff700 1 --2- 172.21.15.5:0/289101800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d4160de0 0x7f79d41611c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79d4066720 tx=0x7f79cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee083ff70a8325 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d27fc700 1 -- 172.21.15.5:0/289101800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00e070 con 0x7f79d4160de0 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d27fc700 1 -- 172.21.15.5:0/289101800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00b910 con 0x7f79d4160de0 2023-08-09T14:15:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d27fc700 1 -- 172.21.15.5:0/289101800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00bcc0 con 0x7f79d4160de0 2023-08-09T14:15:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 -- 172.21.15.5:0/289101800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d4160de0 msgr2=0x7f79d41611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/289101800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d4160de0 0x7f79d41611c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79d4066720 tx=0x7f79cc00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 -- 172.21.15.5:0/289101800 shutdown_connections 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/289101800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d4160de0 0x7f79d41611c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/289101800 >> v2:172.21.15.101:3300/0 conn(0x7f79d415e470 0x7f79d40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 -- 172.21.15.5:0/289101800 >> 172.21.15.5:0/289101800 conn(0x7f79d40cf560 msgr2=0x7f79d40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.439+0000 7f79d9b9a700 1 -- 172.21.15.5:0/289101800 shutdown_connections 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.440+0000 7f79d9b9a700 1 -- 172.21.15.5:0/289101800 wait complete. 2023-08-09T14:15:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.441+0000 7f79d9b9a700 1 Processor -- start 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.441+0000 7f79d9b9a700 1 -- start start 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 0x7f79d41f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79d4160de0 0x7f79d415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d41f6bd0 con 0x7f79d415e470 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40c4020 con 0x7f79d40cd130 2023-08-09T14:15:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d415f150 con 0x7f79d4160de0 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43130/0 (socket says 172.21.15.5:43130) 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 -- 172.21.15.5:0/3831364726 learned_addr learned my addr 172.21.15.5:0/3831364726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d37fe700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 0x7f79d41f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d3fff700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79d4160de0 0x7f79d415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 -- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79d4160de0 msgr2=0x7f79d415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79d4160de0 0x7f79d415a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 -- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 msgr2=0x7f79d41f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 0x7f79d41f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 -- 172.21.15.5:0/3831364726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009b30 con 0x7f79d415e470 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d37fe700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 0x7f79d41f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d2ffd700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00e980 tx=0x7f79bc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc009710 con 0x7f79d415e470 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00c850 con 0x7f79d415e470 2023-08-09T14:15:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d415f430 con 0x7f79d415e470 2023-08-09T14:15:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00cc00 con 0x7f79d415e470 2023-08-09T14:15:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.442+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d415ab10 con 0x7f79d415e470 2023-08-09T14:15:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.443+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4074600 con 0x7f79d415e470 2023-08-09T14:15:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.444+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79bc013470 con 0x7f79d415e470 2023-08-09T14:15:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.444+0000 7f79cbfff700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 0x7f79b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.444+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79bc0885f0 con 0x7f79d415e470 2023-08-09T14:15:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.444+0000 7f79d37fe700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 0x7f79b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.445+0000 7f79d37fe700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 0x7f79b406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000f60 tx=0x7f79c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.449+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f79bc057820 con 0x7f79d415e470 2023-08-09T14:15:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.649+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79d4066090 con 0x7f79d415e470 2023-08-09T14:15:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.650+0000 7f79cbfff700 1 -- 172.21.15.5:0/3831364726 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f79bc0573b0 con 0x7f79d415e470 2023-08-09T14:15:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:39.653 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 msgr2=0x7f79b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 0x7f79b406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000f60 tx=0x7f79c4009040 comp rx=0 tx=0).stop 2023-08-09T14:15:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 msgr2=0x7f79d41f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00e980 tx=0x7f79bc00ed40 comp rx=0 tx=0).stop 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 shutdown_connections 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f79b406a0e0 0x7f79b406c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79d4160de0 0x7f79d415a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79d40cd130 0x7f79d41f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 --2- 172.21.15.5:0/3831364726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d415e470 0x7f79d41f2620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 >> 172.21.15.5:0/3831364726 conn(0x7f79d40cf560 msgr2=0x7f79d40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 shutdown_connections 2023-08-09T14:15:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.653+0000 7f79d9b9a700 1 -- 172.21.15.5:0/3831364726 wait complete. 2023-08-09T14:15:39.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:39.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.793+0000 7f5441069700 1 Processor -- start 2023-08-09T14:15:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.793+0000 7f5441069700 1 -- start start 2023-08-09T14:15:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f5441069700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f5441069700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f543c0ce410 0x7f543c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f5441069700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0cb2d0 con 0x7f543c0b2c70 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f5441069700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0cede0 con 0x7f543c0ce410 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f5441069700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0cb5b0 con 0x7f543c159e90 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f543b59e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f543c0ce410 0x7f543c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f543b59e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f543c0ce410 0x7f543c0ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43140/0 (socket says 172.21.15.5:43140) 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f543b59e700 1 -- 172.21.15.5:0/2954360994 learned_addr learned my addr 172.21.15.5:0/2954360994 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.794+0000 7f543ad9d700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f543b59e700 1 -- 172.21.15.5:0/2954360994 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 msgr2=0x7f543c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f543b59e700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f543b59e700 1 -- 172.21.15.5:0/2954360994 >> v1:172.21.15.101:6789/0 conn(0x7f543c0b2c70 legacy=0x7f543c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f543b59e700 1 -- 172.21.15.5:0/2954360994 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0cb890 con 0x7f543c0ce410 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f543b59e700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0ce410 0x7f543c0ce8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5434009e50 tx=0x7f543400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c673fcc0b8bcb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5439d9b700 1 -- 172.21.15.5:0/2954360994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400e070 con 0x7f543c0ce410 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5439d9b700 1 -- 172.21.15.5:0/2954360994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400b9c0 con 0x7f543c0ce410 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5439d9b700 1 -- 172.21.15.5:0/2954360994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400bd70 con 0x7f543c0ce410 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 -- 172.21.15.5:0/2954360994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0ce410 msgr2=0x7f543c0ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0ce410 0x7f543c0ce8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5434009e50 tx=0x7f543400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 -- 172.21.15.5:0/2954360994 shutdown_connections 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0ce410 0x7f543c0ce8a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 --2- 172.21.15.5:0/2954360994 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 -- 172.21.15.5:0/2954360994 >> 172.21.15.5:0/2954360994 conn(0x7f543c0b1970 msgr2=0x7f543c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 -- 172.21.15.5:0/2954360994 shutdown_connections 2023-08-09T14:15:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.795+0000 7f5441069700 1 -- 172.21.15.5:0/2954360994 wait complete. 2023-08-09T14:15:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.797+0000 7f5441069700 1 Processor -- start 2023-08-09T14:15:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.797+0000 7f5441069700 1 -- start start 2023-08-09T14:15:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f543c0ce410 0x7f543c15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c150080 con 0x7f543c0b2c70 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c15d5d0 con 0x7f543c0ce410 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f5441069700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c15d010 con 0x7f543c159e90 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43142/0 (socket says 172.21.15.5:43142) 2023-08-09T14:15:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 -- 172.21.15.5:0/1041513818 learned_addr learned my addr 172.21.15.5:0/1041513818 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543a59c700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f543c0ce410 0x7f543c15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543b59e700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 -- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 msgr2=0x7f543c06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c06a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 -- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f543c0ce410 msgr2=0x7f543c15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f543c0ce410 0x7f543c15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 -- 172.21.15.5:0/1041513818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434009b30 con 0x7f543c0b2c70 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f543ad9d700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f543000d800 tx=0x7f543000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.798+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300125f0 con 0x7f543c0b2c70 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.799+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430012750 con 0x7f543c0b2c70 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.799+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c15d2f0 con 0x7f543c0b2c70 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.799+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430012b00 con 0x7f543c0b2c70 2023-08-09T14:15:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.799+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c15b860 con 0x7f543c0b2c70 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.800+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c150360 con 0x7f543c0b2c70 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.800+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5430012c60 con 0x7f543c0b2c70 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.800+0000 7f54237fe700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.800+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5430088470 con 0x7f543c0b2c70 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.801+0000 7f543a59c700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.801+0000 7f543a59c700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 0x7f542806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f543c155a10 tx=0x7f542c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:39.805+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5430053bf0 con 0x7f543c0b2c70 2023-08-09T14:15:40.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.005+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f543c074600 con 0x7f543c0b2c70 2023-08-09T14:15:40.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.006+0000 7f54237fe700 1 -- 172.21.15.5:0/1041513818 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5430057210 con 0x7f543c0b2c70 2023-08-09T14:15:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:40.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 msgr2=0x7f542806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 0x7f542806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f543c155a10 tx=0x7f542c009040 comp rx=0 tx=0).stop 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 msgr2=0x7f543c1f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f543000d800 tx=0x7f543000db10 comp rx=0 tx=0).stop 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 shutdown_connections 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f543c159e90 0x7f543c06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0b2c70 0x7f543c1f01c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 --2- 172.21.15.5:0/1041513818 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f543c0ce410 0x7f543c15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 >> 172.21.15.5:0/1041513818 conn(0x7f543c0b1970 msgr2=0x7f543c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 shutdown_connections 2023-08-09T14:15:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.008+0000 7f5441069700 1 -- 172.21.15.5:0/1041513818 wait complete. 2023-08-09T14:15:40.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:40.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.148+0000 7ff70875a700 1 Processor -- start 2023-08-09T14:15:40.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.148+0000 7ff70875a700 1 -- start start 2023-08-09T14:15:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff70875a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7000b2c70 0x7ff7000cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff70875a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff7000ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff70875a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000cb2d0 con 0x7ff700159e90 2023-08-09T14:15:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff70875a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000cee00 con 0x7ff7000b2c70 2023-08-09T14:15:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff70875a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000cb5b0 con 0x7ff7000ce410 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff705cf5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7000b2c70 0x7ff7000cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff7064f6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff700159e90 0x7ff70006db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56566/0 (socket says 172.21.15.5:56566) 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.149+0000 7ff7064f6700 1 -- 172.21.15.5:0/2224748552 learned_addr learned my addr 172.21.15.5:0/2224748552 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff706cf7700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff7000ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff705cf5700 1 -- 172.21.15.5:0/2224748552 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 msgr2=0x7ff7000ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff705cf5700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff7000ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff705cf5700 1 -- 172.21.15.5:0/2224748552 >> v1:172.21.15.5:6789/0 conn(0x7ff700159e90 legacy=0x7ff70006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff705cf5700 1 -- 172.21.15.5:0/2224748552 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000cb890 con 0x7ff7000b2c70 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff705cf5700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000cacd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009840 tx=0x7ff6fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758db73d7fbd311a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff7054f4700 1 -- 172.21.15.5:0/2224748552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc011830 con 0x7ff7000b2c70 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff7054f4700 1 -- 172.21.15.5:0/2224748552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc011990 con 0x7ff7000b2c70 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.150+0000 7ff7054f4700 1 -- 172.21.15.5:0/2224748552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc011d20 con 0x7ff7000b2c70 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 -- 172.21.15.5:0/2224748552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 msgr2=0x7ff7000cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000cacd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009840 tx=0x7ff6fc009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 -- 172.21.15.5:0/2224748552 shutdown_connections 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff7000ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 --2- 172.21.15.5:0/2224748552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000cacd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 -- 172.21.15.5:0/2224748552 >> 172.21.15.5:0/2224748552 conn(0x7ff7000b1970 msgr2=0x7ff7000b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 -- 172.21.15.5:0/2224748552 shutdown_connections 2023-08-09T14:15:40.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.151+0000 7ff70875a700 1 -- 172.21.15.5:0/2224748552 wait complete. 2023-08-09T14:15:40.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.152+0000 7ff70875a700 1 Processor -- start 2023-08-09T14:15:40.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.152+0000 7ff70875a700 1 -- start start 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff70014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 0x7ff7000c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000c9ca0 con 0x7ff7000b2c70 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70014eb80 con 0x7ff700159e90 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000c8210 con 0x7ff7000ce410 2023-08-09T14:15:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43156/0 (socket says 172.21.15.5:43156) 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 -- 172.21.15.5:0/1891590395 learned_addr learned my addr 172.21.15.5:0/1891590395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 -- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 msgr2=0x7ff70014e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff70014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff706cf7700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 0x7ff7000c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 -- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 msgr2=0x7ff7000c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 0x7ff7000c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 -- 172.21.15.5:0/1891590395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0094a0 con 0x7ff7000b2c70 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff706cf7700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 0x7ff7000c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff7064f6700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c480 tx=0x7ff6f000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0005d70 con 0x7ff7000b2c70 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00070d0 con 0x7ff7000b2c70 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7000c9020 con 0x7ff7000b2c70 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0007440 con 0x7ff7000b2c70 2023-08-09T14:15:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.153+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000c95e0 con 0x7ff7000b2c70 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.154+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff700074600 con 0x7ff7000b2c70 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.155+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6f00075a0 con 0x7ff7000b2c70 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.155+0000 7ff6f6ffd700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 0x7ff6e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.155+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6f0087a60 con 0x7ff7000b2c70 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.155+0000 7ff705cf5700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 0x7ff6e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.156+0000 7ff705cf5700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 0x7ff6e406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7001e4560 tx=0x7ff6fc010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.160+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff6f0053160 con 0x7ff7000b2c70 2023-08-09T14:15:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.356+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7000d0740 con 0x7ff7000b2c70 2023-08-09T14:15:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.357+0000 7ff6f6ffd700 1 -- 172.21.15.5:0/1891590395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f0017020 con 0x7ff7000b2c70 2023-08-09T14:15:40.360 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:40.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 msgr2=0x7ff6e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 0x7ff6e406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7001e4560 tx=0x7ff6fc010000 comp rx=0 tx=0).stop 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 msgr2=0x7ff7000c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c480 tx=0x7ff6f000c840 comp rx=0 tx=0).stop 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 shutdown_connections 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff6e406a0e0 0x7ff6e406c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff700159e90 0x7ff7000c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2c70 0x7ff7000c8960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 --2- 172.21.15.5:0/1891590395 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff7000ce410 0x7ff70014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 >> 172.21.15.5:0/1891590395 conn(0x7ff7000b1970 msgr2=0x7ff700159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 shutdown_connections 2023-08-09T14:15:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.359+0000 7ff70875a700 1 -- 172.21.15.5:0/1891590395 wait complete. 2023-08-09T14:15:40.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:40.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.499+0000 7fa54f7df700 1 Processor -- start 2023-08-09T14:15:40.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 -- start start 2023-08-09T14:15:40.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fa54806d570 0x7fa5480ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa548071940 0x7fa548071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54815e0e0 con 0x7fa5480cfff0 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54815ec80 con 0x7fa54806d570 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.500+0000 7fa54f7df700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480722f0 con 0x7fa548071940 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54cd7a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5480cfff0 0x7fa54815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56580/0 (socket says 172.21.15.5:56580) 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54cd7a700 1 -- 172.21.15.5:0/402430313 learned_addr learned my addr 172.21.15.5:0/402430313 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 --2- 172.21.15.5:0/402430313 >> v2:172.21.15.101:3300/0 conn(0x7fa54806d570 0x7fa5480ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54dd7c700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa548071940 0x7fa548071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962760892 0 0) 0x7fa54815e0e0 con 0x7fa5480cfff0 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5340035b0 con 0x7fa5480cfff0 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2756190362 0 0) 0x7fa5340035b0 con 0x7fa5480cfff0 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 -- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa548071940 msgr2=0x7fa548071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa548071940 0x7fa548071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 -- 172.21.15.5:0/402430313 >> v1:172.21.15.5:6789/0 conn(0x7fa5480cfff0 legacy=0x7fa54815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 -- 172.21.15.5:0/402430313 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480665b0 con 0x7fa54806d570 2023-08-09T14:15:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa54d57b700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa5480ceb00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa544009820 tx=0x7fa544009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8859741330707e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c001670 con 0x7fa54806d570 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544005c30 con 0x7fa54806d570 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.501+0000 7fa53bfff700 1 -- 172.21.15.5:0/402430313 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544004030 con 0x7fa54806d570 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 -- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 msgr2=0x7fa5480ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa5480ceb00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa544009820 tx=0x7fa544009b30 comp rx=0 tx=0).stop 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 -- 172.21.15.5:0/402430313 shutdown_connections 2023-08-09T14:15:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa548071940 0x7fa548071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 --2- 172.21.15.5:0/402430313 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa5480ceb00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 -- 172.21.15.5:0/402430313 >> 172.21.15.5:0/402430313 conn(0x7fa5480cf4d0 msgr2=0x7fa5480cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 -- 172.21.15.5:0/402430313 shutdown_connections 2023-08-09T14:15:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.502+0000 7fa54f7df700 1 -- 172.21.15.5:0/402430313 wait complete. 2023-08-09T14:15:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.503+0000 7fa54f7df700 1 Processor -- start 2023-08-09T14:15:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.503+0000 7fa54f7df700 1 -- start start 2023-08-09T14:15:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa54815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa5480cfff0 0x7fa5480cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54809ba20 con 0x7fa548071940 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54809bc70 con 0x7fa54806d570 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54f7df700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54809bf50 con 0x7fa5480cfff0 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43172/0 (socket says 172.21.15.5:43172) 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 -- 172.21.15.5:0/2238515692 learned_addr learned my addr 172.21.15.5:0/2238515692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54d57b700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa54815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54dd7c700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa5480cfff0 0x7fa5480cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 -- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa5480cfff0 msgr2=0x7fa5480cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa5480cfff0 0x7fa5480cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 -- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 msgr2=0x7fa54815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa54815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54cd7a700 1 -- 172.21.15.5:0/2238515692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544009430 con 0x7fa548071940 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.504+0000 7fa54d57b700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa54815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa54cd7a700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c780 tx=0x7fa53c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c004c80 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c004de0 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54809c230 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0072f0 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.505+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5480c5220 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.506+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54809c930 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.506+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa53c007450 con 0x7fa548071940 2023-08-09T14:15:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.507+0000 7fa539ffb700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 0x7fa52c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.507+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa53c088310 con 0x7fa548071940 2023-08-09T14:15:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.507+0000 7fa54d57b700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 0x7fa52c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.507+0000 7fa54d57b700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 0x7fa52c06c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa544000c00 tx=0x7fa544008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.511+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa53c053a10 con 0x7fa548071940 2023-08-09T14:15:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.706+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa54806e470 con 0x7fa548071940 2023-08-09T14:15:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.707+0000 7fa539ffb700 1 -- 172.21.15.5:0/2238515692 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa53c007700 con 0x7fa548071940 2023-08-09T14:15:40.709 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 msgr2=0x7fa52c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 0x7fa52c06c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa544000c00 tx=0x7fa544008070 comp rx=0 tx=0).stop 2023-08-09T14:15:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 msgr2=0x7fa5480cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c780 tx=0x7fa53c00ca90 comp rx=0 tx=0).stop 2023-08-09T14:15:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 shutdown_connections 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa52c06a0e0 0x7fa52c06c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa5480cfff0 0x7fa5480cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa54806d570 0x7fa54815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 --2- 172.21.15.5:0/2238515692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa548071940 0x7fa5480cbf50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 >> 172.21.15.5:0/2238515692 conn(0x7fa5480cf4d0 msgr2=0x7fa54806be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 shutdown_connections 2023-08-09T14:15:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.709+0000 7fa54f7df700 1 -- 172.21.15.5:0/2238515692 wait complete. 2023-08-09T14:15:40.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.848+0000 7f08d2740700 1 Processor -- start 2023-08-09T14:15:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.848+0000 7f08d2740700 1 -- start start 2023-08-09T14:15:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08d2740700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08d2740700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f08cc06a1c0 0x7f08cc06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08d2740700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc06ab50 con 0x7f08cc15d3a0 2023-08-09T14:15:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08d2740700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0cd6c0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08d2740700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0715a0 con 0x7f08cc06a1c0 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08cb7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08cb7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43182/0 (socket says 172.21.15.5:43182) 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.849+0000 7f08cb7fe700 1 -- 172.21.15.5:0/2477876827 learned_addr learned my addr 172.21.15.5:0/2477876827 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08d0cdd700 1 --2- 172.21.15.5:0/2477876827 >> v2:172.21.15.101:3300/0 conn(0x7f08cc06a1c0 0x7f08cc06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08cb7fe700 1 -- 172.21.15.5:0/2477876827 >> v2:172.21.15.101:3300/0 conn(0x7f08cc06a1c0 msgr2=0x7f08cc06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08cb7fe700 1 --2- 172.21.15.5:0/2477876827 >> v2:172.21.15.101:3300/0 conn(0x7f08cc06a1c0 0x7f08cc06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08cb7fe700 1 -- 172.21.15.5:0/2477876827 >> v1:172.21.15.101:6789/0 conn(0x7f08cc15d3a0 legacy=0x7f08cc0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08cb7fe700 1 -- 172.21.15.5:0/2477876827 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0712a0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08cb7fe700 1 --2- 172.21.15.5:0/2477876827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08cc06dda0 tx=0x7f08b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b164a2b7c83f09 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08caffd700 1 -- 172.21.15.5:0/2477876827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400b870 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08caffd700 1 -- 172.21.15.5:0/2477876827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400b9d0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08caffd700 1 -- 172.21.15.5:0/2477876827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400bd60 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08d2740700 1 -- 172.21.15.5:0/2477876827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 msgr2=0x7f08cc0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.850+0000 7f08d2740700 1 --2- 172.21.15.5:0/2477876827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08cc06dda0 tx=0x7f08b4009bd0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 -- 172.21.15.5:0/2477876827 shutdown_connections 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 --2- 172.21.15.5:0/2477876827 >> v2:172.21.15.101:3300/0 conn(0x7f08cc06a1c0 0x7f08cc06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 --2- 172.21.15.5:0/2477876827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0af2c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 -- 172.21.15.5:0/2477876827 >> 172.21.15.5:0/2477876827 conn(0x7f08cc0b1970 msgr2=0x7f08cc0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 -- 172.21.15.5:0/2477876827 shutdown_connections 2023-08-09T14:15:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.851+0000 7f08d2740700 1 -- 172.21.15.5:0/2477876827 wait complete. 2023-08-09T14:15:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.852+0000 7f08d2740700 1 Processor -- start 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.852+0000 7f08d2740700 1 -- start start 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08cc06a1c0 0x7f08cc0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 0x7f08cc1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b32e0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b35c0 con 0x7f08cc15d3a0 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d2740700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b38a0 con 0x7f08cc06a1c0 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43186/0 (socket says 172.21.15.5:43186) 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 -- 172.21.15.5:0/1532725579 learned_addr learned my addr 172.21.15.5:0/1532725579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d0cdd700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 0x7f08cc1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 -- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08cc06a1c0 msgr2=0x7f08cc0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cbfff700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08cc06a1c0 0x7f08cc0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08cc06a1c0 0x7f08cc0c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 -- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 msgr2=0x7f08cc1f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 0x7f08cc1f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 -- 172.21.15.5:0/1532725579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009550 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08d0cdd700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 0x7f08cc1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08cb7fe700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4004540 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40036a0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.853+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003a30 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.854+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0b4210 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.854+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0b2f20 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.854+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc0b30b0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.855+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08b4021070 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.855+0000 7f08c8ff9700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 0x7f08ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:40.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.855+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08b4089cc0 con 0x7f08cc0cd1c0 2023-08-09T14:15:40.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.856+0000 7f08cbfff700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 0x7f08ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:40.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.856+0000 7f08cbfff700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 0x7f08ac06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f08bc000f60 tx=0x7f08bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:40.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:40.860+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f08b4055440 con 0x7f08cc0cd1c0 2023-08-09T14:15:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.058+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08cc074600 con 0x7f08cc0cd1c0 2023-08-09T14:15:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.059+0000 7f08c8ff9700 1 -- 172.21.15.5:0/1532725579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08b40150a0 con 0x7f08cc0cd1c0 2023-08-09T14:15:41.061 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 msgr2=0x7f08ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 0x7f08ac06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f08bc000f60 tx=0x7f08bc009040 comp rx=0 tx=0).stop 2023-08-09T14:15:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 msgr2=0x7f08cc0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b4004750 comp rx=0 tx=0).stop 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 shutdown_connections 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f08ac06a0e0 0x7f08ac06c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08cc15d3a0 0x7f08cc1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08cc06a1c0 0x7f08cc0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 --2- 172.21.15.5:0/1532725579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc0cd1c0 0x7f08cc0b29e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 >> 172.21.15.5:0/1532725579 conn(0x7f08cc0b1970 msgr2=0x7f08cc0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 shutdown_connections 2023-08-09T14:15:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.061+0000 7f08d2740700 1 -- 172.21.15.5:0/1532725579 wait complete. 2023-08-09T14:15:41.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:15:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.198+0000 7f8376b2d700 1 Processor -- start 2023-08-09T14:15:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.198+0000 7f8376b2d700 1 -- start start 2023-08-09T14:15:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f8376b2d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f83700cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f8376b2d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837006e850 con 0x7f837006a1c0 2023-08-09T14:15:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f8376b2d700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837006db70 con 0x7f837006a640 2023-08-09T14:15:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f8376b2d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837006aad0 con 0x7f837015d400 2023-08-09T14:15:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f836ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f837006a1c0 0x7f837006cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56608/0 (socket says 172.21.15.5:56608) 2023-08-09T14:15:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.199+0000 7f836ffff700 1 -- 172.21.15.5:0/2379372463 learned_addr learned my addr 172.21.15.5:0/2379372463 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f83748c9700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f83700cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757091307 0 0) 0x7f837006e850 con 0x7f837006a1c0 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83600035b0 con 0x7f837006a1c0 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750754501 0 0) 0x7f837006db70 con 0x7f837006a640 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837006e850 con 0x7f837006a640 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843401379 0 0) 0x7f83600035b0 con 0x7f837006a1c0 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 msgr2=0x7f83700cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f83700cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 >> v1:172.21.15.101:6789/0 conn(0x7f837006a640 legacy=0x7f837006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700cf7b0 con 0x7f837006a1c0 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f835c001670 con 0x7f837006a1c0 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 >> v1:172.21.15.5:6789/0 conn(0x7f837006a1c0 legacy=0x7f837006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f8360003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f8360004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8360004d90 0x7f8360005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837006aad0 con 0x7f8360004120 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836000baf0 con 0x7f8360004d90 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836000bcb0 con 0x7f837015d400 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f8360004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f83748c9700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f8360003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f83750ca700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8360004d90 0x7f8360005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 -- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 msgr2=0x7f8360003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f837015d400 0x7f8360003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 -- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8360004d90 msgr2=0x7f8360005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f8360004d90 0x7f8360005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.200+0000 7f836ffff700 1 -- 172.21.15.5:0/2379372463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600035b0 con 0x7f8360004120 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f836ffff700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f8360004850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c210 tx=0x7f8360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f9339b2173f02a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00cd50 con 0x7f8360004120 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c005960 con 0x7f8360004120 2023-08-09T14:15:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f836f7fe700 1 -- 172.21.15.5:0/2379372463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c005cd0 con 0x7f8360004120 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 -- 172.21.15.5:0/2379372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 msgr2=0x7f8360004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 --2- 172.21.15.5:0/2379372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f8360004850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c210 tx=0x7f8360005880 comp rx=0 tx=0).stop 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f83750ca700 1 -- 172.21.15.5:0/2379372463 reap_dead start 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 -- 172.21.15.5:0/2379372463 shutdown_connections 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 -- 172.21.15.5:0/2379372463 >> 172.21.15.5:0/2379372463 conn(0x7f83700b1900 msgr2=0x7f83700b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 -- 172.21.15.5:0/2379372463 shutdown_connections 2023-08-09T14:15:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.201+0000 7f8376b2d700 1 -- 172.21.15.5:0/2379372463 wait complete. 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.202+0000 7f8376b2d700 1 Processor -- start 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 -- start start 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f83701f34b0 0x7f83701f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 0x7f837015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837015ad90 con 0x7f8360004120 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700c5020 con 0x7f837015a3d0 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f8376b2d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700c5300 con 0x7f83701f34b0 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.203+0000 7f83748c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43204/0 (socket says 172.21.15.5:43204) 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 -- 172.21.15.5:0/558965967 learned_addr learned my addr 172.21.15.5:0/558965967 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83750ca700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 0x7f837015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f836ffff700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f83701f34b0 0x7f83701f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 -- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f83701f34b0 msgr2=0x7f83701f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f83701f34b0 0x7f83701f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 -- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 msgr2=0x7f837015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 0x7f837015a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 -- 172.21.15.5:0/558965967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700c55e0 con 0x7f8360004120 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83750ca700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 0x7f837015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f83748c9700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8364011aa0 tx=0x7f8364011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400f980 con 0x7f8360004120 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400fae0 con 0x7f8360004120 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400fe90 con 0x7f8360004120 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83700c58c0 con 0x7f8360004120 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.204+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83700cb680 con 0x7f8360004120 2023-08-09T14:15:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.205+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8370074600 con 0x7f8360004120 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.206+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8364014440 con 0x7f8360004120 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.206+0000 7f836d7fa700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 0x7f835406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.206+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8364088bc0 con 0x7f8360004120 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.206+0000 7f836ffff700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 0x7f835406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.207+0000 7f836ffff700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 0x7f835406c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83700ca320 tx=0x7f835c007f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.210+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8364054400 con 0x7f8360004120 2023-08-09T14:15:41.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.456+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83700c3090 con 0x7f8360004120 2023-08-09T14:15:41.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.456+0000 7f836d7fa700 1 -- 172.21.15.5:0/558965967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7f8364022020 con 0x7f8360004120 2023-08-09T14:15:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:41.459 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 msgr2=0x7f835406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 0x7f835406c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83700ca320 tx=0x7f835c007f90 comp rx=0 tx=0).stop 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 msgr2=0x7f83701f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8364011aa0 tx=0x7f8364011e60 comp rx=0 tx=0).stop 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 shutdown_connections 2023-08-09T14:15:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f835406a0e0 0x7f835406c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f837015a3d0 0x7f837015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360004120 0x7f83701f3be0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 --2- 172.21.15.5:0/558965967 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f83701f34b0 0x7f83701f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.458+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 >> 172.21.15.5:0/558965967 conn(0x7f83700b1900 msgr2=0x7f83700cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.459+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 shutdown_connections 2023-08-09T14:15:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.459+0000 7f8376b2d700 1 -- 172.21.15.5:0/558965967 wait complete. 2023-08-09T14:15:41.463 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:15:41.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.595+0000 7fef0e8ab700 1 Processor -- start 2023-08-09T14:15:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.595+0000 7fef0e8ab700 1 -- start start 2023-08-09T14:15:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef0e8ab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef0815e750 0x7fef080cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef0e8ab700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fef080b4d20 0x7fef080cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef0e8ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef080cfc10 con 0x7fef080cea90 2023-08-09T14:15:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef0e8ab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080cf000 con 0x7fef0815e750 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef0e8ab700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080cf2e0 con 0x7fef080b4d20 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef07fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef0815e750 0x7fef080cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef077fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef080cea90 0x7fef080cbad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56628/0 (socket says 172.21.15.5:56628) 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef077fe700 1 -- 172.21.15.5:0/2159652699 learned_addr learned my addr 172.21.15.5:0/2159652699 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.596+0000 7fef07fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef0815e750 0x7fef080cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43212/0 (socket says 172.21.15.5:43212) 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef0ce48700 1 --2- 172.21.15.5:0/2159652699 >> v2:172.21.15.101:3300/0 conn(0x7fef080b4d20 0x7fef080cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef07fff700 1 -- 172.21.15.5:0/2159652699 >> v2:172.21.15.101:3300/0 conn(0x7fef080b4d20 msgr2=0x7fef080cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef07fff700 1 --2- 172.21.15.5:0/2159652699 >> v2:172.21.15.101:3300/0 conn(0x7fef080b4d20 0x7fef080cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef07fff700 1 -- 172.21.15.5:0/2159652699 >> v1:172.21.15.5:6789/0 conn(0x7fef080cea90 legacy=0x7fef080cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef07fff700 1 -- 172.21.15.5:0/2159652699 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080cf5c0 con 0x7fef0815e750 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef06ffd700 1 -- 172.21.15.5:0/2159652699 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308909074 0 0) 0x7fef080cfc10 con 0x7fef080cea90 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef07fff700 1 --2- 172.21.15.5:0/2159652699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef0815e750 0x7fef080cd790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef08071de0 tx=0x7feef8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b3ac7a0134af64 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef06ffd700 1 -- 172.21.15.5:0/2159652699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8011830 con 0x7fef0815e750 2023-08-09T14:15:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef06ffd700 1 -- 172.21.15.5:0/2159652699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8011990 con 0x7fef0815e750 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.597+0000 7fef06ffd700 1 -- 172.21.15.5:0/2159652699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8011d20 con 0x7fef0815e750 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 -- 172.21.15.5:0/2159652699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef0815e750 msgr2=0x7fef080cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/2159652699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef0815e750 0x7fef080cd790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef08071de0 tx=0x7feef8009b20 comp rx=0 tx=0).stop 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 -- 172.21.15.5:0/2159652699 shutdown_connections 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/2159652699 >> v2:172.21.15.101:3300/0 conn(0x7fef080b4d20 0x7fef080cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/2159652699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef0815e750 0x7fef080cd790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 -- 172.21.15.5:0/2159652699 >> 172.21.15.5:0/2159652699 conn(0x7fef0809a180 msgr2=0x7fef080d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 -- 172.21.15.5:0/2159652699 shutdown_connections 2023-08-09T14:15:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.598+0000 7fef0e8ab700 1 -- 172.21.15.5:0/2159652699 wait complete. 2023-08-09T14:15:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.599+0000 7fef0e8ab700 1 Processor -- start 2023-08-09T14:15:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.599+0000 7fef0e8ab700 1 -- start start 2023-08-09T14:15:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fef080cea90 0x7fef080ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fef0815e750 0x7fef0806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef081471e0 con 0x7fef080b4d20 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080ca6c0 con 0x7fef0815e750 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef080ca980 con 0x7fef080cea90 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43218/0 (socket says 172.21.15.5:43218) 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 -- 172.21.15.5:0/4082827892 learned_addr learned my addr 172.21.15.5:0/4082827892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 -- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fef080cea90 msgr2=0x7fef080ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0ce48700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fef0815e750 0x7fef0806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fef080cea90 0x7fef080ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 -- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fef0815e750 msgr2=0x7fef0806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fef0815e750 0x7fef0806f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 -- 172.21.15.5:0/4082827892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80094a0 con 0x7fef080b4d20 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef07fff700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feef8009b60 tx=0x7feef8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80038a0 con 0x7fef080b4d20 2023-08-09T14:15:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef801e070 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8003c00 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.600+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef080cac60 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.601+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef080cb220 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.601+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef080ce030 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.602+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feef802d450 con 0x7fef080b4d20 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.602+0000 7fef04ff9700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 0x7feee806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.602+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feef80894d0 con 0x7fef080b4d20 2023-08-09T14:15:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.603+0000 7fef077fe700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 0x7feee806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.603+0000 7fef077fe700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 0x7feee806c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feef00011e0 tx=0x7feef00079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.607+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feef8054c50 con 0x7fef080b4d20 2023-08-09T14:15:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.807+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef08074600 con 0x7fef080b4d20 2023-08-09T14:15:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.809+0000 7fef04ff9700 1 -- 172.21.15.5:0/4082827892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7feef8058270 con 0x7fef080b4d20 2023-08-09T14:15:41.811 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:41.811 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 msgr2=0x7feee806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 0x7feee806c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feef00011e0 tx=0x7feef00079b0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 msgr2=0x7fef081592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feef8009b60 tx=0x7feef8004750 comp rx=0 tx=0).stop 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 shutdown_connections 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feee806a0e0 0x7feee806c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fef0815e750 0x7fef0806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef080b4d20 0x7fef081592d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 --2- 172.21.15.5:0/4082827892 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fef080cea90 0x7fef080ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 >> 172.21.15.5:0/4082827892 conn(0x7fef0809a180 msgr2=0x7fef0815b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 shutdown_connections 2023-08-09T14:15:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.811+0000 7fef0e8ab700 1 -- 172.21.15.5:0/4082827892 wait complete. 2023-08-09T14:15:41.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:15:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.948+0000 7f5a00ce2700 1 Processor -- start 2023-08-09T14:15:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.948+0000 7f5a00ce2700 1 -- start start 2023-08-09T14:15:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f5a00ce2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59fc071170 0x7f59fc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f5a00ce2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc06e4c0 con 0x7f59fc06a8d0 2023-08-09T14:15:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f5a00ce2700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0cc170 con 0x7f59fc15b020 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f5a00ce2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc06eb60 con 0x7f59fc071170 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f59fad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59fc071170 0x7f59fc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f59f9d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59fc06a8d0 0x7f59fc0b2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56642/0 (socket says 172.21.15.5:56642) 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.949+0000 7f59f9d9b700 1 -- 172.21.15.5:0/3433919017 learned_addr learned my addr 172.21.15.5:0/3433919017 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59fad9d700 1 -- 172.21.15.5:0/3433919017 >> v1:172.21.15.101:6789/0 conn(0x7f59fc15b020 legacy=0x7f59fc06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59fad9d700 1 -- 172.21.15.5:0/3433919017 >> v1:172.21.15.5:6789/0 conn(0x7f59fc06a8d0 legacy=0x7f59fc0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59fad9d700 1 -- 172.21.15.5:0/3433919017 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0cc450 con 0x7f59fc071170 2023-08-09T14:15:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59fad9d700 1 --2- 172.21.15.5:0/3433919017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc071170 0x7f59fc0b34c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009d90 tx=0x7f59f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b9e587603c1ad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59f959a700 1 -- 172.21.15.5:0/3433919017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400e070 con 0x7f59fc071170 2023-08-09T14:15:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59f959a700 1 -- 172.21.15.5:0/3433919017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400bb90 con 0x7f59fc071170 2023-08-09T14:15:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f59f959a700 1 -- 172.21.15.5:0/3433919017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4003a20 con 0x7f59fc071170 2023-08-09T14:15:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f5a00ce2700 1 -- 172.21.15.5:0/3433919017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc071170 msgr2=0x7f59fc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.950+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/3433919017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc071170 0x7f59fc0b34c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009d90 tx=0x7f59f400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.951+0000 7f5a00ce2700 1 -- 172.21.15.5:0/3433919017 shutdown_connections 2023-08-09T14:15:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.951+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/3433919017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc071170 0x7f59fc0b34c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.951+0000 7f5a00ce2700 1 -- 172.21.15.5:0/3433919017 >> 172.21.15.5:0/3433919017 conn(0x7f59fc0b1900 msgr2=0x7f59fc0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.951+0000 7f5a00ce2700 1 -- 172.21.15.5:0/3433919017 shutdown_connections 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.951+0000 7f5a00ce2700 1 -- 172.21.15.5:0/3433919017 wait complete. 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.952+0000 7f5a00ce2700 1 Processor -- start 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.952+0000 7f5a00ce2700 1 -- start start 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59fc06a8d0 0x7f59fc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59fc071170 0x7f59fc15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc14bf80 con 0x7f59fc15b020 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc15c980 con 0x7f59fc06a8d0 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc15cc60 con 0x7f59fc071170 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43234/0 (socket says 172.21.15.5:43234) 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 -- 172.21.15.5:0/2072581171 learned_addr learned my addr 172.21.15.5:0/2072581171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fa59c700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59fc06a8d0 0x7f59fc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 -- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59fc071170 msgr2=0x7f59fc15be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59fc071170 0x7f59fc15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 -- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59fc06a8d0 msgr2=0x7f59fc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59fc06a8d0 0x7f59fc0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 -- 172.21.15.5:0/2072581171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4009a70 con 0x7f59fc15b020 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59fad9d700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0b26f0 tx=0x7f59f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4012630 con 0x7f59fc15b020 2023-08-09T14:15:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40127b0 con 0x7f59fc15b020 2023-08-09T14:15:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc1490c0 con 0x7f59fc15b020 2023-08-09T14:15:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.953+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4012b60 con 0x7f59fc15b020 2023-08-09T14:15:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.954+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc149680 con 0x7f59fc15b020 2023-08-09T14:15:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.954+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc074600 con 0x7f59fc15b020 2023-08-09T14:15:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.955+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f59f4012cc0 con 0x7f59fc15b020 2023-08-09T14:15:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.955+0000 7f59eaffd700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.955+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59f408af40 con 0x7f59fc15b020 2023-08-09T14:15:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.956+0000 7f59fa59c700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.956+0000 7f59fa59c700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f000a7d0 tx=0x7f59f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:41.960+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f59f40566c0 con 0x7f59fc15b020 2023-08-09T14:15:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.201+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59fc0cb690 con 0x7f59fc15b020 2023-08-09T14:15:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.201+0000 7f59eaffd700 1 -- 172.21.15.5:0/2072581171 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7f59f4059ce0 con 0x7f59fc15b020 2023-08-09T14:15:42.204 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:42.204 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:15:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.203+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 msgr2=0x7f59dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.203+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f000a7d0 tx=0x7f59f0008040 comp rx=0 tx=0).stop 2023-08-09T14:15:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.203+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 msgr2=0x7f59fc15c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.203+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0b26f0 tx=0x7f59f4004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.203+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 shutdown_connections 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59fc15b020 0x7f59fc15c350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f59fc06a8d0 0x7f59fc0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 --2- 172.21.15.5:0/2072581171 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f59fc071170 0x7f59fc15be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 >> 172.21.15.5:0/2072581171 conn(0x7f59fc0b1900 msgr2=0x7f59fc0b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 shutdown_connections 2023-08-09T14:15:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.204+0000 7f5a00ce2700 1 -- 172.21.15.5:0/2072581171 wait complete. 2023-08-09T14:15:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:15:42.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T14:15:26.772406+0000', 'modified': '2023-08-09T14:15:30.369218+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.101:6835/4162053601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6834', 'nonce': 4162053601}, {'type': 'v1', 'addr': '172.21.15.101:6835', 'nonce': 4162053601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T14:15:42.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T14:15:42.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-09T14:15:42.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.750+0000 7f31a0334700 1 Processor -- start 2023-08-09T14:15:42.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.750+0000 7f31a0334700 1 -- start start 2023-08-09T14:15:42.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f31a0334700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f31980cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f31a0334700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f31980b4d20 0x7f31980cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f31a0334700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980cfc10 con 0x7f31980cea90 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f31a0334700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980cf000 con 0x7f31980b4d20 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f31a0334700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980cf2e0 con 0x7f319815e750 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d8cf700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f31980cea90 0x7f31980cbad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56654/0 (socket says 172.21.15.5:56654) 2023-08-09T14:15:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d8cf700 1 -- 172.21.15.5:0/2880978054 learned_addr learned my addr 172.21.15.5:0/2880978054 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319e8d1700 1 --2- 172.21.15.5:0/2880978054 >> v2:172.21.15.101:3300/0 conn(0x7f31980b4d20 0x7f31980cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705427664 0 0) 0x7f31980cfc10 con 0x7f31980cea90 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f31980cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31840035b0 con 0x7f31980cea90 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139912433 0 0) 0x7f31840035b0 con 0x7f31980cea90 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 msgr2=0x7f31980cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f31980cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 >> v2:172.21.15.101:3300/0 conn(0x7f31980b4d20 msgr2=0x7f31980cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 --2- 172.21.15.5:0/2880978054 >> v2:172.21.15.101:3300/0 conn(0x7f31980b4d20 0x7f31980cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980cf5c0 con 0x7f31980cea90 2023-08-09T14:15:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.751+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f3188001670 con 0x7f31980cea90 2023-08-09T14:15:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 >> v1:172.21.15.5:6789/0 conn(0x7f31980cea90 legacy=0x7f31980cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f3184003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f3184004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3184004d90 0x7f3184005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980cf000 con 0x7f3184003a00 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980cf2e0 con 0x7f3184004d90 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318400ba10 con 0x7f319815e750 2023-08-09T14:15:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f3184003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d8cf700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f3184004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e8d1700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3184004d90 0x7f3184005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 -- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 msgr2=0x7f3184004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f319815e750 0x7f3184004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 -- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3184004d90 msgr2=0x7f3184005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3184004d90 0x7f3184005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 -- 172.21.15.5:0/2880978054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840035b0 con 0x7f3184003a00 2023-08-09T14:15:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f3184003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3194009b60 tx=0x7f3184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d938a750c8293a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400e6c0 con 0x7f3184003a00 2023-08-09T14:15:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400e820 con 0x7f3184003a00 2023-08-09T14:15:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.752+0000 7f319d0ce700 1 -- 172.21.15.5:0/2880978054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400eb90 con 0x7f3184003a00 2023-08-09T14:15:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 -- 172.21.15.5:0/2880978054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 msgr2=0x7f3184003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 --2- 172.21.15.5:0/2880978054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f3184003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3194009b60 tx=0x7f3184005880 comp rx=0 tx=0).stop 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f319e8d1700 1 -- 172.21.15.5:0/2880978054 reap_dead start 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 -- 172.21.15.5:0/2880978054 shutdown_connections 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 -- 172.21.15.5:0/2880978054 >> 172.21.15.5:0/2880978054 conn(0x7f319809a180 msgr2=0x7f31980d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 -- 172.21.15.5:0/2880978054 shutdown_connections 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.753+0000 7f31a0334700 1 -- 172.21.15.5:0/2880978054 wait complete. 2023-08-09T14:15:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.754+0000 7f31a0334700 1 Processor -- start 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.754+0000 7f31a0334700 1 -- start start 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3198157e60 0x7f3198152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 0x7f31980c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c90b0 con 0x7f3184003a00 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981570c0 con 0x7f31980c86f0 2023-08-09T14:15:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f31a0334700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319806cb10 con 0x7f3198157e60 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43250/0 (socket says 172.21.15.5:43250) 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 -- 172.21.15.5:0/3092918866 learned_addr learned my addr 172.21.15.5:0/3092918866 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e8d1700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 0x7f31980c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319d8cf700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3198157e60 0x7f3198152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 -- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3198157e60 msgr2=0x7f3198152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3198157e60 0x7f3198152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 -- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 msgr2=0x7f31980c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 0x7f31980c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 -- 172.21.15.5:0/3092918866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198157380 con 0x7f3184003a00 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e8d1700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 0x7f31980c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31840046e0 tx=0x7f31940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.755+0000 7f318effd700 1 -- 172.21.15.5:0/3092918866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400e6c0 con 0x7f3184003a00 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.756+0000 7f318effd700 1 -- 172.21.15.5:0/3092918866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194003ab0 con 0x7f3184003a00 2023-08-09T14:15:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.756+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198157660 con 0x7f3184003a00 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.756+0000 7f318effd700 1 -- 172.21.15.5:0/3092918866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194003e60 con 0x7f3184003a00 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.756+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198152a40 con 0x7f3184003a00 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.757+0000 7f318effd700 1 -- 172.21.15.5:0/3092918866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3194013470 con 0x7f3184003a00 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.757+0000 7f318effd700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 0x7f317c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.757+0000 7f318effd700 1 -- 172.21.15.5:0/3092918866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3194089ef0 con 0x7f3184003a00 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.758+0000 7f319d8cf700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 0x7f317c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.758+0000 7f319d8cf700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 0x7f317c06c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f319806d010 tx=0x7f3188009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.759+0000 7f31ac4cdb80 1 Processor -- start 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.760+0000 7f31ac4cdb80 1 -- start start 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.760+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e67cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e3d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295d96060 con 0x557295e67910 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295d93980 con 0x557295e79330 2023-08-09T14:15:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x557295d8f270 con 0x557295e3a070 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43258/0 (socket says 172.21.15.5:43258) 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 -- 172.21.15.5:0/3168374846 learned_addr learned my addr 172.21.15.5:0/3168374846 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e8d1700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e3d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319d8cf700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e67cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 -- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 msgr2=0x557295e67cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e67cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 -- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 msgr2=0x557295e3d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e3d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 -- 172.21.15.5:0/3168374846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557295c0f5e0 con 0x557295e67910 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e8d1700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e3d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f319e0d0700 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31940090b0 tx=0x7f3194059b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e1a4bd7489f3c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f317bfff700 1 -- 172.21.15.5:0/3168374846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319405d020 con 0x557295e67910 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f317bfff700 1 -- 172.21.15.5:0/3168374846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194061160 con 0x557295e67910 2023-08-09T14:15:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.761+0000 7f317bfff700 1 -- 172.21.15.5:0/3168374846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194009730 con 0x557295e67910 2023-08-09T14:15:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/3168374846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 msgr2=0x557295e831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31940090b0 tx=0x7f3194059b60 comp rx=0 tx=0).stop 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/3168374846 shutdown_connections 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e3d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e831a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/3168374846 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e67cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/3168374846 >> 172.21.15.5:0/3168374846 conn(0x557295d6b130 msgr2=0x557295e82720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/3168374846 shutdown_connections 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.762+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/3168374846 wait complete. 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.763+0000 7f31ac4cdb80 1 -- start start 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.763+0000 7f31ac4cdb80 1 Processor -- start 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e85890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e5fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295d2da70 con 0x557295e67910 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295d2d770 con 0x557295e79330 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x557295c118d0 con 0x557295e3a070 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 10 client.0 _ll_register_callbacks cb 0x557295d2b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43266/0 (socket says 172.21.15.5:43266) 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 -- 172.21.15.5:0/2270387427 learned_addr learned my addr 172.21.15.5:0/2270387427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319e8d1700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e5fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e85890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 -- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 msgr2=0x557295e85890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e85890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 -- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 msgr2=0x557295e5fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e5fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 -- 172.21.15.5:0/2270387427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198152a40 con 0x557295e67910 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f319d8cf700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31880156e0 tx=0x7f3188000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6739218412d3add server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31797fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188015db0 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f318801a040 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.764+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557295d311a0 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f318802c450 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 10 client.4647 fetch_fsmap learned FSMap version 7 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557295bbbd90 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557295d311a0 con 0x557295e67910 2023-08-09T14:15:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f318802c5b0 con 0x557295e67910 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 10 client.4647 fetch_fsmap finished waiting for FSMap version 7 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 20 client.4647 populate_metadata read hostname 'smithi005' 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295e6b0d0 0x557295e3c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 4 client.4647 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 --> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557295d88250 con 0x557295e6b0d0 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.765+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295e6b0d0 0x557295e3c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31797fa700 10 client.4647 ms_handle_connect on v2:172.21.15.101:6834/4162053601 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f319e0d0700 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295e6b0d0 0x557295e3c1f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b15b7abd17cd37 server_cookie=13395e7be9f0e4d in_seq=0 out_seq=0 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31797fa700 1 -- 172.21.15.5:0/2270387427 <== mds.0 v2:172.21.15.101:6834/4162053601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557295d88250 con 0x557295e6b0d0 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31797fa700 10 client.4647 handle_command_reply: tid=0 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 client.4647 shutdown 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 msgr2=0x557295e5f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31880156e0 tx=0x7f3188000fe0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 shutdown_connections 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e5fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295e6b0d0 0x557295e3c1f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e3a070 0x557295e85890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/2270387427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e67910 0x557295e5f730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.766+0000 7f31797fa700 0 client.4647 ms_handle_reset on v2:172.21.15.101:6834/4162053601 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.767+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 >> 172.21.15.5:0/2270387427 conn(0x557295d6b130 msgr2=0x557295e7b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.767+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 shutdown_connections 2023-08-09T14:15:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.767+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/2270387427 wait complete. 2023-08-09T14:15:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.767+0000 7f31ac4cdb80 20 client.4647 trim_cache size 0 max 16384 2023-08-09T14:15:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.784+0000 7f31ac4cdb80 1 Processor -- start 2023-08-09T14:15:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.784+0000 7f31ac4cdb80 1 -- start start 2023-08-09T14:15:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 0x557295e37690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e67cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295e7baa0 con 0x557295e3a070 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295e396b0 con 0x557295e79330 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x557295e3de90 con 0x557295e67910 2023-08-09T14:15:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43272/0 (socket says 172.21.15.5:43272) 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 -- 172.21.15.5:0/1567307138 learned_addr learned my addr 172.21.15.5:0/1567307138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e8d1700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e67cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319d8cf700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 0x557295e37690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 -- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 msgr2=0x557295e37690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 0x557295e37690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 -- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 msgr2=0x557295e67cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e67cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.785+0000 7f319e0d0700 1 -- 172.21.15.5:0/1567307138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557295ba4c10 con 0x557295e3a070 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f319d8cf700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 0x557295e37690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3194060c30 tx=0x7f319402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee14085c121544f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f318cda2700 1 -- 172.21.15.5:0/1567307138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194088040 con 0x557295e3a070 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f318cda2700 1 -- 172.21.15.5:0/1567307138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194055790 con 0x557295e3a070 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f318cda2700 1 -- 172.21.15.5:0/1567307138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194055b60 con 0x557295e3a070 2023-08-09T14:15:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1567307138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 msgr2=0x557295e94220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3194060c30 tx=0x7f319402d000 comp rx=0 tx=0).stop 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1567307138 shutdown_connections 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e79330 0x557295e67cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e94220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1567307138 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e67910 0x557295e37690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1567307138 >> 172.21.15.5:0/1567307138 conn(0x557295d6b130 msgr2=0x557295e82ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1567307138 shutdown_connections 2023-08-09T14:15:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.786+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1567307138 wait complete. 2023-08-09T14:15:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.787+0000 7f31ac4cdb80 1 -- start start 2023-08-09T14:15:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.787+0000 7f31ac4cdb80 1 Processor -- start 2023-08-09T14:15:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e67910 0x557295e92e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e79330 0x557295e93390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295e63c00 con 0x557295e3a070 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x557295e93d70 con 0x557295e67910 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x557295e38020 con 0x557295e79330 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31ac4cdb80 10 client.0 _ll_register_callbacks cb 0x557295d2b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T14:15:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43278/0 (socket says 172.21.15.5:43278) 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 -- 172.21.15.5:0/1021890323 learned_addr learned my addr 172.21.15.5:0/1021890323 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319d8cf700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e67910 0x557295e92e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e8d1700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e79330 0x557295e93390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 -- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e79330 msgr2=0x557295e93390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e79330 0x557295e93390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 -- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e67910 msgr2=0x557295e92e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e67910 0x557295e92e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 -- 172.21.15.5:0/1021890323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557295c0f5e0 con 0x557295e3a070 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f319e0d0700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3194055950 tx=0x7f319405f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba5bcc70d842d99 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.788+0000 7f31797fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194088040 con 0x557295e3a070 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31940578b0 con 0x557295e3a070 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3194061160 con 0x557295e3a070 2023-08-09T14:15:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3194058940 con 0x557295e3a070 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 10 client.4653 fetch_fsmap learned FSMap version 7 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557295be2200 con 0x557295e3a070 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194061160 con 0x557295e3a070 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3194060cd0 con 0x557295e3a070 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 20 client.4653 populate_metadata read hostname 'smithi005' 2023-08-09T14:15:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295ede350 0x557295e364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 4 client.4653 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 --> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557295d49000 con 0x557295ede350 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.789+0000 7f319d8cf700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295ede350 0x557295e364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31797fa700 10 client.4653 ms_handle_connect on v2:172.21.15.101:6834/4162053601 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f319d8cf700 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295ede350 0x557295e364b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d02fbd569e2a7e server_cookie=97325b70f95ba84c in_seq=0 out_seq=0 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31797fa700 1 -- 172.21.15.5:0/1021890323 <== mds.0 v2:172.21.15.101:6834/4162053601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557295d49000 con 0x557295ede350 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31797fa700 10 client.4653 handle_command_reply: tid=0 2023-08-09T14:15:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 client.4653 shutdown 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 msgr2=0x557295e784b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3194055950 tx=0x7f319405f040 comp rx=0 tx=0).stop 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 shutdown_connections 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:6834/4162053601,v1:172.21.15.101:6835/4162053601] conn(0x557295ede350 0x557295e364b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x557295e79330 0x557295e93390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557295e3a070 0x557295e784b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31797fa700 0 client.4653 ms_handle_reset on v2:172.21.15.101:6834/4162053601 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 --2- 172.21.15.5:0/1021890323 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x557295e67910 0x557295e92e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 >> 172.21.15.5:0/1021890323 conn(0x557295d6b130 msgr2=0x557295e82e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 shutdown_connections 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 1 -- 172.21.15.5:0/1021890323 wait complete. 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.790+0000 7f31ac4cdb80 20 client.4653 trim_cache size 0 max 16384 2023-08-09T14:15:42.802 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "59d7238d-6ce2-4e7c-9329-64c716150f65", 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4288, 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 15.445824865000001, 2023-08-09T14:15:42.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2023-08-09T14:15:42.804 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 21, 2023-08-09T14:15:42.804 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 21, 2023-08-09T14:15:42.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21.342182649000002 2023-08-09T14:15:42.804 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-08-09T14:15:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 msgr2=0x7f317c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 0x7f317c06c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f319806d010 tx=0x7f3188009040 comp rx=0 tx=0).stop 2023-08-09T14:15:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 msgr2=0x7f31980ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31840046e0 tx=0x7f31940047c0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 shutdown_connections 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f317c06a110 0x7f317c06c5d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f31980c86f0 0x7f31980c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3184003a00 0x7f31980ca990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 --2- 172.21.15.5:0/3092918866 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3198157e60 0x7f3198152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 >> 172.21.15.5:0/3092918866 conn(0x7f319809a180 msgr2=0x7f31980b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 shutdown_connections 2023-08-09T14:15:42.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:42.791+0000 7f31a0334700 1 -- 172.21.15.5:0/3092918866 wait complete. 2023-08-09T14:15:42.807 INFO:teuthology.run_tasks:Running task kclient... 2023-08-09T14:15:42.829 INFO:tasks.kclient:Mounting kernel clients... 2023-08-09T14:15:42.830 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-09T14:15:42.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:42.831 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-08-09T14:15:42.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:42.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-08-09T14:15:42.918 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-08-09T14:15:42.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:15:42.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:42.920 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-08-09T14:15:42.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:42.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-08-09T14:15:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-08-09T14:15:43.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:15:43.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.047 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list 2023-08-09T14:15:43.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.068 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link delete ceph-brx 2023-08-09T14:15:43.143 INFO:teuthology.orchestra.run.smithi101.stderr:Cannot find device "ceph-brx" 2023-08-09T14:15:43.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:15:43.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.145 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list 2023-08-09T14:15:43.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.205 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link delete ceph-brx 2023-08-09T14:15:43.274 INFO:teuthology.orchestra.run.smithi101.stderr:Cannot find device "ceph-brx" 2023-08-09T14:15:43.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:15:43.276 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-09T14:15:43.276 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T14:15:43.276 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T14:15:43.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T14:15:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.403+0000 7f89e85ab700 1 Processor -- start 2023-08-09T14:15:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.403+0000 7f89e85ab700 1 -- start start 2023-08-09T14:15:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e85ab700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f89e015b360 0x7f89e015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e85ab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e00ce410 0x7f89e00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e85ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00cee00 con 0x7f89e0154600 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e85ab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e015eb20 con 0x7f89e00ce410 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e85ab700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e006d4f0 con 0x7f89e015b360 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e6b48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e00ce410 0x7f89e00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e6347700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89e0154600 0x7f89e015b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56702/0 (socket says 172.21.15.5:56702) 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e6347700 1 -- 172.21.15.5:0/1552664462 learned_addr learned my addr 172.21.15.5:0/1552664462 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.404+0000 7f89e6b48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e00ce410 0x7f89e00ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43290/0 (socket says 172.21.15.5:43290) 2023-08-09T14:15:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e5b46700 1 --2- 172.21.15.5:0/1552664462 >> v2:172.21.15.101:3300/0 conn(0x7f89e015b360 0x7f89e015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e6b48700 1 -- 172.21.15.5:0/1552664462 >> v2:172.21.15.101:3300/0 conn(0x7f89e015b360 msgr2=0x7f89e015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e6b48700 1 --2- 172.21.15.5:0/1552664462 >> v2:172.21.15.101:3300/0 conn(0x7f89e015b360 0x7f89e015dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e6b48700 1 -- 172.21.15.5:0/1552664462 >> v1:172.21.15.5:6789/0 conn(0x7f89e0154600 legacy=0x7f89e015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e6b48700 1 -- 172.21.15.5:0/1552664462 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e015e560 con 0x7f89e00ce410 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e5345700 1 -- 172.21.15.5:0/1552664462 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571618802 0 0) 0x7f89d0001110 con 0x7f89e0154600 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e6b48700 1 --2- 172.21.15.5:0/1552664462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00ce410 0x7f89e00ce8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89e0071df0 tx=0x7f89d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2be07fa293343c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e5345700 1 -- 172.21.15.5:0/1552664462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800e070 con 0x7f89e00ce410 2023-08-09T14:15:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e5345700 1 -- 172.21.15.5:0/1552664462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800bb20 con 0x7f89e00ce410 2023-08-09T14:15:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.405+0000 7f89e5345700 1 -- 172.21.15.5:0/1552664462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8012430 con 0x7f89e00ce410 2023-08-09T14:15:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 -- 172.21.15.5:0/1552664462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00ce410 msgr2=0x7f89e00ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 --2- 172.21.15.5:0/1552664462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00ce410 0x7f89e00ce8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89e0071df0 tx=0x7f89d800b330 comp rx=0 tx=0).stop 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 -- 172.21.15.5:0/1552664462 shutdown_connections 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 --2- 172.21.15.5:0/1552664462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00ce410 0x7f89e00ce8c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 --2- 172.21.15.5:0/1552664462 >> v2:172.21.15.101:3300/0 conn(0x7f89e015b360 0x7f89e015dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 -- 172.21.15.5:0/1552664462 >> 172.21.15.5:0/1552664462 conn(0x7f89e00b1900 msgr2=0x7f89e00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 -- 172.21.15.5:0/1552664462 shutdown_connections 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.406+0000 7f89e85ab700 1 -- 172.21.15.5:0/1552664462 wait complete. 2023-08-09T14:15:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.407+0000 7f89e85ab700 1 Processor -- start 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.407+0000 7f89e85ab700 1 -- start start 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89e00ce410 0x7f89e0146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89e015b360 0x7f89e006a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00ae400 con 0x7f89e0154600 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e0147500 con 0x7f89e015b360 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00ad7f0 con 0x7f89e00ce410 2023-08-09T14:15:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43294/0 (socket says 172.21.15.5:43294) 2023-08-09T14:15:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 -- 172.21.15.5:0/3348092971 learned_addr learned my addr 172.21.15.5:0/3348092971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e6b48700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89e015b360 0x7f89e006a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e6347700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89e00ce410 0x7f89e0146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 -- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89e00ce410 msgr2=0x7f89e0146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89e00ce410 0x7f89e0146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 -- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89e015b360 msgr2=0x7f89e006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89e015b360 0x7f89e006a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 -- 172.21.15.5:0/3348092971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009a70 con 0x7f89e0154600 2023-08-09T14:15:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e5b46700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00e840 tx=0x7f89dc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc009590 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc013680 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e00adad0 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc013a30 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.408+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e00ae090 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.409+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e0074600 con 0x7f89e0154600 2023-08-09T14:15:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.410+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89dc013b90 con 0x7f89e0154600 2023-08-09T14:15:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.410+0000 7f89d6ffd700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 0x7f89c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.410+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89dc088440 con 0x7f89e0154600 2023-08-09T14:15:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.410+0000 7f89e6347700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 0x7f89c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.411+0000 7f89e6347700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 0x7f89c406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89d0000f60 tx=0x7f89d0007c20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.415+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f89dc057520 con 0x7f89e0154600 2023-08-09T14:15:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.659+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89e00ae540 con 0x7f89e0154600 2023-08-09T14:15:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.659+0000 7f89d6ffd700 1 -- 172.21.15.5:0/3348092971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89dc0570b0 con 0x7f89e0154600 2023-08-09T14:15:43.662 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T14:15:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 msgr2=0x7f89c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 0x7f89c406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89d0000f60 tx=0x7f89d0007c20 comp rx=0 tx=0).stop 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 msgr2=0x7f89e0152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00e840 tx=0x7f89dc00eb50 comp rx=0 tx=0).stop 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 shutdown_connections 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89c406a0e0 0x7f89c406c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89e015b360 0x7f89e006a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89e00ce410 0x7f89e0146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 --2- 172.21.15.5:0/3348092971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e0154600 0x7f89e0152d00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 >> 172.21.15.5:0/3348092971 conn(0x7f89e00b1900 msgr2=0x7f89e015dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 shutdown_connections 2023-08-09T14:15:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:43.661+0000 7f89e85ab700 1 -- 172.21.15.5:0/3348092971 wait complete. 2023-08-09T14:15:43.675 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T14:15:43.675 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T14:15:43.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-08-09T14:15:43.676 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T14:15:43.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T14:15:43.676 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T14:15:43.676 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T14:15:43.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T14:15:43.677 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T14:15:43.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.677 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-08-09T14:15:43.694 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:43.695 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:43.696 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:43.697 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-09T14:15:43.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:43.698 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:43.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-08-09T14:15:43.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-08-09T14:15:43.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-08-09T14:15:43.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-09T14:15:43.699 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:43.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.863 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T14:15:43.893 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-08-09T14:15:43.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.894 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-08-09T14:15:43.967 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-08-09T14:15:43.967 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T14:15:43.968 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T14:15:43.968 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T14:15:43.968 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T14:15:43.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:43.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:43.969 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:43.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T14:15:43.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T14:15:43.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T14:15:43.970 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:44.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.226 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-08-09T14:15:44.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.244 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-08-09T14:15:44.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:44.302 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:44.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T14:15:44.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-09T14:15:44.303 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:44.398 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-09T14:15:44.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:44.399 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:44.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-09T14:15:44.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-09T14:15:44.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-09T14:15:44.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-09T14:15:44.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-09T14:15:44.400 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:44.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.626 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:44.626 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:44.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-08-09T14:15:44.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-08-09T14:15:44.627 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:44.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:44.730 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T14:15:44.753 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T14:15:44.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:44.754 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T14:15:44.810 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-09T14:15:44.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:44.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:44.902 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:44.903 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:45.020 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:45.020 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:45.020 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:45.020 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:45.020 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:45.021 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:45.021 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:45.021 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:45.095 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:45.095 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:45.095 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790" 2023-08-09T14:15:45.097 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790:/ 2023-08-09T14:15:45.097 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65" will pass to kernel 2023-08-09T14:15:45.098 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T14:15:45.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T14:15:45.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:45.215 INFO:teuthology.orchestra.run.smithi005.stdout:client4654 2023-08-09T14:15:45.216 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:45.216 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:15:45.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.233 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:45.322 INFO:teuthology.orchestra.run.smithi005.stdout:client4654 2023-08-09T14:15:45.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.323 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:45.368 INFO:teuthology.orchestra.run.smithi005.stdout:client4654 2023-08-09T14:15:45.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59d7238d-6ce2-4e7c-9329-64c716150f65.client4654/status') 2023-08-09T14:15:45.425 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4654 (3)172.21.15.5:0/1393589223 2023-08-09T14:15:45.425 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-08-09T14:15:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-08-09T14:15:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-08-09T14:15:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.4793e-05 s, 2.8 MB/s 2023-08-09T14:15:45.426 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-08-09T14:15:45.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T14:15:45.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-09T14:15:45.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T14:15:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.550+0000 7f89d66fb700 1 Processor -- start 2023-08-09T14:15:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.550+0000 7f89d66fb700 1 -- start start 2023-08-09T14:15:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d66fb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d0071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d66fb700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f89d00b2db0 0x7f89d00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d66fb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00716b0 con 0x7f89d015b020 2023-08-09T14:15:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d66fb700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d006eb60 con 0x7f89d00b2db0 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d66fb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d006e4c0 con 0x7f89d006a8d0 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89d015b020 0x7f89d006a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56728/0 (socket says 172.21.15.5:56728) 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cffff700 1 -- 172.21.15.5:0/3199974535 learned_addr learned my addr 172.21.15.5:0/3199974535 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cf7fe700 1 --2- 172.21.15.5:0/3199974535 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89d4c98700 1 --2- 172.21.15.5:0/3199974535 >> v2:172.21.15.101:3300/0 conn(0x7f89d00b2db0 0x7f89d00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89ceffd700 1 -- 172.21.15.5:0/3199974535 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828206390 0 0) 0x7f89c4001110 con 0x7f89d015b020 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89ceffd700 1 -- 172.21.15.5:0/3199974535 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b80035b0 con 0x7f89d015b020 2023-08-09T14:15:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cf7fe700 1 -- 172.21.15.5:0/3199974535 >> v2:172.21.15.101:3300/0 conn(0x7f89d00b2db0 msgr2=0x7f89d00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cf7fe700 1 --2- 172.21.15.5:0/3199974535 >> v2:172.21.15.101:3300/0 conn(0x7f89d00b2db0 0x7f89d00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cf7fe700 1 -- 172.21.15.5:0/3199974535 >> v1:172.21.15.5:6789/0 conn(0x7f89d015b020 legacy=0x7f89d006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.551+0000 7f89cf7fe700 1 -- 172.21.15.5:0/3199974535 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00cc170 con 0x7f89d006a8d0 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89cf7fe700 1 --2- 172.21.15.5:0/3199974535 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d0071170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009840 tx=0x7f89c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f86f71e2d7a797f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89ceffd700 1 -- 172.21.15.5:0/3199974535 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0011830 con 0x7f89d006a8d0 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89ceffd700 1 -- 172.21.15.5:0/3199974535 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0011990 con 0x7f89d006a8d0 2023-08-09T14:15:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89ceffd700 1 -- 172.21.15.5:0/3199974535 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0011d20 con 0x7f89d006a8d0 2023-08-09T14:15:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199974535 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 msgr2=0x7f89d0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199974535 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d0071170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009840 tx=0x7f89c0009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199974535 shutdown_connections 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199974535 >> v2:172.21.15.101:3300/0 conn(0x7f89d00b2db0 0x7f89d00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199974535 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d0071170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199974535 >> 172.21.15.5:0/3199974535 conn(0x7f89d00b1900 msgr2=0x7f89d00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199974535 shutdown_connections 2023-08-09T14:15:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.552+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199974535 wait complete. 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.554+0000 7f89d66fb700 1 Processor -- start 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 -- start start 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d00c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89d00b2db0 0x7f89d01f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c9750 con 0x7f89d015b020 2023-08-09T14:15:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01530d0 con 0x7f89d00b2db0 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.555+0000 7f89d66fb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01533b0 con 0x7f89d006a8d0 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43318/0 (socket says 172.21.15.5:43318) 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 -- 172.21.15.5:0/3199179521 learned_addr learned my addr 172.21.15.5:0/3199179521 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89cffff700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d00c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89cf7fe700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89d00b2db0 0x7f89d01f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 -- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 msgr2=0x7f89d00c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d00c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 -- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89d00b2db0 msgr2=0x7f89d01f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89d00b2db0 0x7f89d01f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 -- 172.21.15.5:0/3199179521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00094a0 con 0x7f89d015b020 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d4c98700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f89c800efc0 tx=0x7f89c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8009ea0 con 0x7f89d015b020 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c800f040 con 0x7f89d015b020 2023-08-09T14:15:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d0153690 con 0x7f89d015b020 2023-08-09T14:15:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800ced0 con 0x7f89d015b020 2023-08-09T14:15:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.556+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d0150ff0 con 0x7f89d015b020 2023-08-09T14:15:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.557+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0153bb0 con 0x7f89d015b020 2023-08-09T14:15:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.558+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89c8014480 con 0x7f89d015b020 2023-08-09T14:15:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.558+0000 7f89ccff9700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.558+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89c8088d90 con 0x7f89d015b020 2023-08-09T14:15:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.558+0000 7f89cffff700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.559+0000 7f89cffff700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89c4007fd0 tx=0x7f89c4007c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.563+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f89d0153bb0 con 0x7f89d015b020 2023-08-09T14:15:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.811+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89d0153bb0 con 0x7f89d015b020 2023-08-09T14:15:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.811+0000 7f89ccff9700 1 -- 172.21.15.5:0/3199179521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89d0153bb0 con 0x7f89d015b020 2023-08-09T14:15:45.814 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T14:15:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 msgr2=0x7f89bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89c4007fd0 tx=0x7f89c4007c40 comp rx=0 tx=0).stop 2023-08-09T14:15:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 msgr2=0x7f89d01f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f89c800efc0 tx=0x7f89c800c3a0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 shutdown_connections 2023-08-09T14:15:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89d015b020 0x7f89d01f4160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f89d006a8d0 0x7f89d00c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 --2- 172.21.15.5:0/3199179521 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f89d00b2db0 0x7f89d01f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 >> 172.21.15.5:0/3199179521 conn(0x7f89d00b1900 msgr2=0x7f89d00cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 shutdown_connections 2023-08-09T14:15:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:45.813+0000 7f89d66fb700 1 -- 172.21.15.5:0/3199179521 wait complete. 2023-08-09T14:15:45.828 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T14:15:45.828 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T14:15:45.828 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-08-09T14:15:45.829 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-09T14:15:45.829 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-09T14:15:45.829 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T14:15:45.829 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T14:15:45.829 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T14:15:45.830 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-09T14:15:45.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.830 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-08-09T14:15:45.847 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.848 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-08-09T14:15:45.849 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e2:3a:68:45:72:e7 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.850 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a822:11ff:fe93:cb20/64 scope link 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e2:3a:68:45:72:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e03a:68ff:fe45:72e7/64 scope link tentative 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:45.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.852 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T14:15:45.914 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-08-09T14:15:45.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.916 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-08-09T14:15:45.974 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-08-09T14:15:45.975 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T14:15:45.975 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T14:15:45.975 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T14:15:45.975 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T14:15:45.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:45.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:45.976 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:45.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T14:15:45.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T14:15:45.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T14:15:45.977 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:46.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.083 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-08-09T14:15:46.105 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T14:15:46.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.107 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-08-09T14:15:46.172 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-09T14:15:46.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.173 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:46.173 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:46.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T14:15:46.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-09T14:15:46.175 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:46.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-09T14:15:46.309 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:46.309 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 8a:80:49:13:8a:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T14:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T14:15:46.311 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.311 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::8880:49ff:fe13:8a28/64 scope link 2023-08-09T14:15:46.311 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-09T14:15:46.407 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:46.408 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:46.408 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:46.408 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.408 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:46.409 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.409 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:46.409 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 8a:80:49:13:8a:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T14:15:46.409 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T14:15:46.410 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.410 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::8880:49ff:fe13:8a28/64 scope link 2023-08-09T14:15:46.410 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:46.422 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-09T14:15:46.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.423 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:46.424 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:46.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-09T14:15:46.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-09T14:15:46.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-09T14:15:46.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-09T14:15:46.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-09T14:15:46.426 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:46.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:15:46.680 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:15:46.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2023-08-09T14:15:46.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2023-08-09T14:15:46.681 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:15:46.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:46.803 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-09T14:15:46.830 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-09T14:15:46.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:46.831 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-09T14:15:46.893 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-08-09T14:15:46.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:46.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:46.981 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:46.981 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:47.012 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:47.012 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:47.012 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:47.012 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:47.013 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:47.013 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:47.013 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:47.013 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790" 2023-08-09T14:15:47.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790:/ 2023-08-09T14:15:47.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65" will pass to kernel 2023-08-09T14:15:47.090 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T14:15:47.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-09T14:15:47.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:47.193 INFO:teuthology.orchestra.run.smithi005.stdout:client4663 2023-08-09T14:15:47.194 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:15:47.195 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:15:47.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.251 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:47.323 INFO:teuthology.orchestra.run.smithi005.stdout:client4663 2023-08-09T14:15:47.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.325 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:47.396 INFO:teuthology.orchestra.run.smithi005.stdout:client4663 2023-08-09T14:15:47.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.397 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59d7238d-6ce2-4e7c-9329-64c716150f65.client4663/status') 2023-08-09T14:15:47.478 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4663 (3)172.21.15.5:0/3472971599 2023-08-09T14:15:47.479 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-08-09T14:15:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-08-09T14:15:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-08-09T14:15:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.5035e-05 s, 2.8 MB/s 2023-08-09T14:15:47.480 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-09T14:15:47.481 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T14:15:47.481 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T14:15:47.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T14:15:47.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.643+0000 7f1e5eae3700 1 Processor -- start 2023-08-09T14:15:47.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.643+0000 7f1e5eae3700 1 -- start start 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5eae3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 0x7f1e5806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5eae3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5806b2d0 con 0x7f1e5806bd90 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5eae3700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e580ceef0 con 0x7f1e5815d2a0 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5eae3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58070080 con 0x7f1e5806f6d0 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5d080700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e5806bd90 0x7f1e5806c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56748/0 (socket says 172.21.15.5:56748) 2023-08-09T14:15:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e5d080700 1 -- 172.21.15.5:0/3835557811 learned_addr learned my addr 172.21.15.5:0/3835557811 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e57fff700 1 --2- 172.21.15.5:0/3835557811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 0x7f1e5806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649528491 0 0) 0x7f1e5806b2d0 con 0x7f1e5806bd90 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e480035b0 con 0x7f1e5806bd90 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702289100 0 0) 0x7f1e580ceef0 con 0x7f1e5815d2a0 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.644+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5806b2d0 con 0x7f1e5815d2a0 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e57fff700 1 -- 172.21.15.5:0/3835557811 >> v1:172.21.15.101:6789/0 conn(0x7f1e5815d2a0 legacy=0x7f1e580b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e57fff700 1 -- 172.21.15.5:0/3835557811 >> v1:172.21.15.5:6789/0 conn(0x7f1e5806bd90 legacy=0x7f1e5806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686309742 0 0) 0x7f1e480035b0 con 0x7f1e5806bd90 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e57fff700 1 -- 172.21.15.5:0/3835557811 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e580cf1d0 con 0x7f1e5806f6d0 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e57fff700 1 --2- 172.21.15.5:0/3835557811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 0x7f1e5806fb40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=260dca248e6dc662 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500019f0 con 0x7f1e5806f6d0 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e44004030 con 0x7f1e5806f6d0 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e577fe700 1 -- 172.21.15.5:0/3835557811 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440043c0 con 0x7f1e5806f6d0 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3835557811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 msgr2=0x7f1e5806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3835557811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 0x7f1e5806fb40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e44009b80 comp rx=0 tx=0).stop 2023-08-09T14:15:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3835557811 shutdown_connections 2023-08-09T14:15:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3835557811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806f6d0 0x7f1e5806fb40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3835557811 >> 172.21.15.5:0/3835557811 conn(0x7f1e580d0fd0 msgr2=0x7f1e580d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.645+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3835557811 shutdown_connections 2023-08-09T14:15:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.646+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3835557811 wait complete. 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.647+0000 7f1e5eae3700 1 Processor -- start 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.647+0000 7f1e5eae3700 1 -- start start 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806bd90 0x7f1e58146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 0x7f1e580c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58154850 con 0x7f1e5806f6d0 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58147020 con 0x7f1e5815d2a0 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581562b0 con 0x7f1e5806bd90 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43336/0 (socket says 172.21.15.5:43336) 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 -- 172.21.15.5:0/3293142094 learned_addr learned my addr 172.21.15.5:0/3293142094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5d080700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 0x7f1e580c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5c87f700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806bd90 0x7f1e58146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 -- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806bd90 msgr2=0x7f1e58146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806bd90 0x7f1e58146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 -- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 msgr2=0x7f1e580c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 0x7f1e580c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 -- 172.21.15.5:0/3293142094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440094a0 con 0x7f1e5806f6d0 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5d080700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 0x7f1e580c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e57fff700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000c00 tx=0x7f1e44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44003e30 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4401f070 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e58154490 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44011870 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.648+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e580ca560 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.649+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e58154990 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.650+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e44021030 con 0x7f1e5806f6d0 2023-08-09T14:15:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.650+0000 7f1e557fa700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 0x7f1e3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:47.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.650+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e44089850 con 0x7f1e5806f6d0 2023-08-09T14:15:47.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.650+0000 7f1e5c87f700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 0x7f1e3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:47.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.651+0000 7f1e5c87f700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 0x7f1e3c06c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c007fd0 tx=0x7f1e4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:47.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.655+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1e58154990 con 0x7f1e5806f6d0 2023-08-09T14:15:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.899+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e58154990 con 0x7f1e5806f6d0 2023-08-09T14:15:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.900+0000 7f1e557fa700 1 -- 172.21.15.5:0/3293142094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e58154990 con 0x7f1e5806f6d0 2023-08-09T14:15:47.902 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 msgr2=0x7f1e3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 0x7f1e3c06c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c007fd0 tx=0x7f1e4c009040 comp rx=0 tx=0).stop 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 msgr2=0x7f1e580c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000c00 tx=0x7f1e44004750 comp rx=0 tx=0).stop 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 shutdown_connections 2023-08-09T14:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1e3c06a0e0 0x7f1e3c06c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1e5815d2a0 0x7f1e580c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1e5806bd90 0x7f1e58146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 --2- 172.21.15.5:0/3293142094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5806f6d0 0x7f1e580c5a80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 >> 172.21.15.5:0/3293142094 conn(0x7f1e580d0fd0 msgr2=0x7f1e580d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 shutdown_connections 2023-08-09T14:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:47.902+0000 7f1e5eae3700 1 -- 172.21.15.5:0/3293142094 wait complete. 2023-08-09T14:15:47.916 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T14:15:47.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T14:15:47.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi101.front.sepia.ceph.com 2023-08-09T14:15:47.917 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T14:15:47.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T14:15:47.918 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T14:15:47.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T14:15:47.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T14:15:47.918 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T14:15:47.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.919 DEBUG:teuthology.orchestra.run.smithi101:> ip addr 2023-08-09T14:15:47.940 INFO:teuthology.orchestra.run.smithi101.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:47.940 INFO:teuthology.orchestra.run.smithi101.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:47.940 INFO:teuthology.orchestra.run.smithi101.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:47.940 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:d8:a1:f2 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:d8:a1:f3 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:47.941 INFO:teuthology.orchestra.run.smithi101.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:8f:d7:22 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:8f:d7:23 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: inet 172.21.15.101/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft 42415sec preferred_lft 42415sec 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::6d2c:dcc0:2f00:48b2/64 scope link noprefixroute 2023-08-09T14:15:47.942 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:47.943 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-09T14:15:47.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:47.943 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:47.944 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:47.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link add name ceph-brx type bridge 2023-08-09T14:15:47.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip addr flush dev ceph-brx 2023-08-09T14:15:47.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link set ceph-brx up 2023-08-09T14:15:47.945 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-09T14:15:47.945 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:48.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.117 DEBUG:teuthology.orchestra.run.smithi101:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T14:15:48.146 INFO:teuthology.orchestra.run.smithi101.stdout:1 2023-08-09T14:15:48.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.149 DEBUG:teuthology.orchestra.run.smithi101:> route 2023-08-09T14:15:48.222 INFO:teuthology.orchestra.run.smithi101.stdout:Kernel IP routing table 2023-08-09T14:15:48.222 INFO:teuthology.orchestra.run.smithi101.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T14:15:48.222 INFO:teuthology.orchestra.run.smithi101.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T14:15:48.222 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T14:15:48.222 INFO:teuthology.orchestra.run.smithi101.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T14:15:48.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.223 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:48.223 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:48.223 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T14:15:48.224 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T14:15:48.224 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T14:15:48.224 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:48.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.491 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list 2023-08-09T14:15:48.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.508 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list-id 2023-08-09T14:15:48.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.564 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:48.565 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:48.565 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T14:15:48.565 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-09T14:15:48.566 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:48.658 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-09T14:15:48.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.659 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:48.659 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:48.659 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-09T14:15:48.659 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-09T14:15:48.660 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-09T14:15:48.660 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-09T14:15:48.660 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-09T14:15:48.661 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:48.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:48.866 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:48.867 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:48.867 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link set brx.0 up 2023-08-09T14:15:48.867 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link set dev brx.0 master ceph-brx 2023-08-09T14:15:48.867 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:48.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:48.967 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T14:15:48.988 INFO:teuthology.orchestra.run.smithi101.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T14:15:48.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:48.989 DEBUG:teuthology.orchestra.run.smithi101:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T14:15:49.045 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-09T14:15:49.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.045 DEBUG:teuthology.orchestra.run.smithi101:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:49.139 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:49.139 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:49.243 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:49.243 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:49.243 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:49.243 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with new device syntax: 1@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:49.244 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:49.244 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:49.244 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:49.244 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:49.274 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:49.274 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:49.274 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:49.274 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with new device syntax: 1@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790" 2023-08-09T14:15:49.275 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790:/ 2023-08-09T14:15:49.276 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65" will pass to kernel 2023-08-09T14:15:49.277 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T14:15:49.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.278 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T14:15:49.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.308 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:49.379 INFO:teuthology.orchestra.run.smithi101.stdout:client4517 2023-08-09T14:15:49.380 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:49.381 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:15:49.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.437 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:49.508 INFO:teuthology.orchestra.run.smithi101.stdout:client4517 2023-08-09T14:15:49.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.509 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:49.580 INFO:teuthology.orchestra.run.smithi101.stdout:client4517 2023-08-09T14:15:49.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:49.581 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59d7238d-6ce2-4e7c-9329-64c716150f65.client4517/status') 2023-08-09T14:15:49.660 INFO:teuthology.orchestra.run.smithi101.stdout:instance: client.4517 (3)192.168.0.1:0/3764714520 2023-08-09T14:15:49.661 INFO:teuthology.orchestra.run.smithi101.stdout:blocklisted: false 2023-08-09T14:15:49.661 INFO:teuthology.orchestra.run.smithi101.stderr:0+1 records in 2023-08-09T14:15:49.662 INFO:teuthology.orchestra.run.smithi101.stderr:0+1 records out 2023-08-09T14:15:49.662 INFO:teuthology.orchestra.run.smithi101.stderr:69 bytes copied, 3.4703e-05 s, 2.0 MB/s 2023-08-09T14:15:49.662 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-08-09T14:15:49.662 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T14:15:49.663 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-09T14:15:49.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T14:15:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.801+0000 7f446d46e700 1 Processor -- start 2023-08-09T14:15:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.801+0000 7f446d46e700 1 -- start start 2023-08-09T14:15:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f446d46e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f446815d5d0 0x7f44680d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f446d46e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f446d46e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680d0760 con 0x7f44680b2130 2023-08-09T14:15:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f446d46e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44680b00d0 con 0x7f446815d5d0 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f446d46e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680ce7f0 con 0x7f44680b04f0 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f44677fe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f44667fc700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f44680b2130 0x7f44680d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38104/0 (socket says 172.21.15.5:38104) 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4466ffd700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f446815d5d0 0x7f44680d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f44677fe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:32928/0 (socket says 172.21.15.5:32928) 2023-08-09T14:15:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f44667fc700 1 -- 172.21.15.5:0/1706249981 learned_addr learned my addr 172.21.15.5:0/1706249981 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4465ffb700 1 -- 172.21.15.5:0/1706249981 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833092837 0 0) 0x7f44680d0760 con 0x7f44680b2130 2023-08-09T14:15:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4465ffb700 1 -- 172.21.15.5:0/1706249981 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44500035b0 con 0x7f44680b2130 2023-08-09T14:15:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4466ffd700 1 -- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 msgr2=0x7f44680b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4466ffd700 1 -- 172.21.15.5:0/1706249981 >> v1:172.21.15.101:6789/0 conn(0x7f44680b2130 legacy=0x7f44680d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f4466ffd700 1 -- 172.21.15.5:0/1706249981 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680afd60 con 0x7f446815d5d0 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.802+0000 7f44677fe700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680d0f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f445c009840 tx=0x7f445c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d87755d5a64894 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f4465ffb700 1 -- 172.21.15.5:0/1706249981 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c011830 con 0x7f446815d5d0 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f4465ffb700 1 -- 172.21.15.5:0/1706249981 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c011990 con 0x7f446815d5d0 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f4465ffb700 1 -- 172.21.15.5:0/1706249981 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c011d20 con 0x7f446815d5d0 2023-08-09T14:15:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 -- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 msgr2=0x7f44680d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680d0f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f445c009840 tx=0x7f445c009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 -- 172.21.15.5:0/1706249981 shutdown_connections 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 --2- 172.21.15.5:0/1706249981 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680d0f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 -- 172.21.15.5:0/1706249981 >> 172.21.15.5:0/1706249981 conn(0x7f44680d3090 msgr2=0x7f44680d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 -- 172.21.15.5:0/1706249981 shutdown_connections 2023-08-09T14:15:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.803+0000 7f446d46e700 1 -- 172.21.15.5:0/1706249981 wait complete. 2023-08-09T14:15:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 Processor -- start 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 -- start start 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44681529e0 con 0x7f44680b2130 2023-08-09T14:15:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680c82f0 con 0x7f446815d5d0 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.805+0000 7f446d46e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680c8b90 con 0x7f44680b04f0 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43350/0 (socket says 172.21.15.5:43350) 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 -- 172.21.15.5:0/1752142943 learned_addr learned my addr 172.21.15.5:0/1752142943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44677fe700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 -- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 msgr2=0x7f44680b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 -- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 msgr2=0x7f44680c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 -- 172.21.15.5:0/1752142943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4460009a70 con 0x7f44680b2130 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f44667fc700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4458005910 tx=0x7f445800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458005b40 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458005ca0 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458007310 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c0094a0 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.806+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44680b82d0 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.807+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446806c930 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.808+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4458007470 con 0x7f44680b2130 2023-08-09T14:15:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.809+0000 7f444f7fe700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.809+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4458087bb0 con 0x7f44680b2130 2023-08-09T14:15:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.809+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.809+0000 7f4466ffd700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 0x7f445406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f445c000c00 tx=0x7f445c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:49.812+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4458053410 con 0x7f44680b2130 2023-08-09T14:15:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.063+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44680c8d00 con 0x7f44680b2130 2023-08-09T14:15:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.063+0000 7f444f7fe700 1 -- 172.21.15.5:0/1752142943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4458017070 con 0x7f44680b2130 2023-08-09T14:15:50.066 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T14:15:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 msgr2=0x7f445406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 0x7f445406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f445c000c00 tx=0x7f445c008030 comp rx=0 tx=0).stop 2023-08-09T14:15:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 msgr2=0x7f44680b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4458005910 tx=0x7f445800c7b0 comp rx=0 tx=0).stop 2023-08-09T14:15:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 shutdown_connections 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f446815d5d0 0x7f44680c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f44680b04f0 0x7f44680b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 --2- 172.21.15.5:0/1752142943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44680b2130 0x7f44680b25a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 >> 172.21.15.5:0/1752142943 conn(0x7f44680d3090 msgr2=0x7f446815d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 shutdown_connections 2023-08-09T14:15:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:50.065+0000 7f446d46e700 1 -- 172.21.15.5:0/1752142943 wait complete. 2023-08-09T14:15:50.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T14:15:50.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T14:15:50.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi101.front.sepia.ceph.com 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T14:15:50.081 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-09T14:15:50.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.082 DEBUG:teuthology.orchestra.run.smithi101:> ip addr 2023-08-09T14:15:50.100 INFO:teuthology.orchestra.run.smithi101.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:50.101 INFO:teuthology.orchestra.run.smithi101.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:50.101 INFO:teuthology.orchestra.run.smithi101.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:50.101 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.101 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:50.102 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.102 INFO:teuthology.orchestra.run.smithi101.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:50.102 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:d8:a1:f2 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:50.103 INFO:teuthology.orchestra.run.smithi101.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:50.103 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:d8:a1:f3 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:50.103 INFO:teuthology.orchestra.run.smithi101.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:15:50.104 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:8f:d7:22 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:50.104 INFO:teuthology.orchestra.run.smithi101.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T14:15:50.104 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 0c:c4:7a:8f:d7:23 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:50.104 INFO:teuthology.orchestra.run.smithi101.stdout: inet 172.21.15.101/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T14:15:50.105 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft 42412sec preferred_lft 42412sec 2023-08-09T14:15:50.105 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::6d2c:dcc0:2f00:48b2/64 scope link noprefixroute 2023-08-09T14:15:50.105 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.105 INFO:teuthology.orchestra.run.smithi101.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 3a:9e:cc:fe:a8:70 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::70ab:bdff:fefc:717e/64 scope link 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.106 INFO:teuthology.orchestra.run.smithi101.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T14:15:50.107 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 3a:9e:cc:fe:a8:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T14:15:50.107 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::389e:ccff:fefe:a870/64 scope link 2023-08-09T14:15:50.107 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.107 DEBUG:teuthology.orchestra.run.smithi101:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T14:15:50.165 INFO:teuthology.orchestra.run.smithi101.stdout:1 2023-08-09T14:15:50.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.168 DEBUG:teuthology.orchestra.run.smithi101:> route 2023-08-09T14:15:50.226 INFO:teuthology.orchestra.run.smithi101.stdout:Kernel IP routing table 2023-08-09T14:15:50.226 INFO:teuthology.orchestra.run.smithi101.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T14:15:50.226 INFO:teuthology.orchestra.run.smithi101.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T14:15:50.226 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T14:15:50.226 INFO:teuthology.orchestra.run.smithi101.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T14:15:50.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.227 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:50.227 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:50.228 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T14:15:50.228 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T14:15:50.228 DEBUG:teuthology.orchestra.run.smithi101:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T14:15:50.228 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:50.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.330 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list 2023-08-09T14:15:50.346 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T14:15:50.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.347 DEBUG:teuthology.orchestra.run.smithi101:> ip netns list-id 2023-08-09T14:15:50.403 INFO:teuthology.orchestra.run.smithi101.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-09T14:15:50.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.404 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:50.404 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:50.404 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T14:15:50.405 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-09T14:15:50.405 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:50.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.496 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-09T14:15:50.533 INFO:teuthology.orchestra.run.smithi101.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.534 INFO:teuthology.orchestra.run.smithi101.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:50.535 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 1a:b1:c0:b9:a8:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T14:15:50.535 INFO:teuthology.orchestra.run.smithi101.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T14:15:50.535 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.535 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::18b1:c0ff:feb9:a8d1/64 scope link 2023-08-09T14:15:50.535 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.552 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-09T14:15:50.631 INFO:teuthology.orchestra.run.smithi101.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 ::1/128 scope host 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.632 INFO:teuthology.orchestra.run.smithi101.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:15:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: link/ether 1a:b1:c0:b9:a8:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T14:15:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T14:15:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: inet6 fe80::18b1:c0ff:feb9:a8d1/64 scope link 2023-08-09T14:15:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:15:50.643 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-09T14:15:50.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.643 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:50.644 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:50.644 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-09T14:15:50.644 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-09T14:15:50.645 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-09T14:15:50.645 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-09T14:15:50.646 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-09T14:15:50.646 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:50.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:50.885 DEBUG:teuthology.orchestra.run.smithi101:> (cd / && exec bash -c ' 2023-08-09T14:15:50.885 DEBUG:teuthology.orchestra.run.smithi101:> set -e 2023-08-09T14:15:50.885 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link set brx.1 up 2023-08-09T14:15:50.885 DEBUG:teuthology.orchestra.run.smithi101:> sudo ip link set dev brx.1 master ceph-brx 2023-08-09T14:15:50.886 DEBUG:teuthology.orchestra.run.smithi101:> ') 2023-08-09T14:15:50.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:50.994 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-09T14:15:51.014 INFO:teuthology.orchestra.run.smithi101.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-09T14:15:51.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:15:51.015 DEBUG:teuthology.orchestra.run.smithi101:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-09T14:15:51.071 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-08-09T14:15:51.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.071 DEBUG:teuthology.orchestra.run.smithi101:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:51.156 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:51.156 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:51.183 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:51.183 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:51.183 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:51.183 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with new device syntax: 3@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:51.184 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:51.184 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:51.184 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:51.184 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:51.210 INFO:teuthology.orchestra.run.smithi101.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:15:51.210 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:15:51.210 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with new device syntax: 3@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790" 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790:/ 2023-08-09T14:15:51.211 INFO:teuthology.orchestra.run.smithi101.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65" will pass to kernel 2023-08-09T14:15:51.229 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T14:15:51.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.230 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-09T14:15:51.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.259 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:51.330 INFO:teuthology.orchestra.run.smithi101.stdout:client4681 2023-08-09T14:15:51.330 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:15:51.331 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:15:51.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.387 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:51.459 INFO:teuthology.orchestra.run.smithi101.stdout:client4681 2023-08-09T14:15:51.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.460 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:15:51.531 INFO:teuthology.orchestra.run.smithi101.stdout:client4681 2023-08-09T14:15:51.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:15:51.532 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59d7238d-6ce2-4e7c-9329-64c716150f65.client4681/status') 2023-08-09T14:15:51.611 INFO:teuthology.orchestra.run.smithi101.stdout:instance: client.4681 (3)192.168.0.2:0/1478834544 2023-08-09T14:15:51.611 INFO:teuthology.orchestra.run.smithi101.stdout:blocklisted: false 2023-08-09T14:15:51.612 INFO:teuthology.orchestra.run.smithi101.stderr:0+1 records in 2023-08-09T14:15:51.612 INFO:teuthology.orchestra.run.smithi101.stderr:0+1 records out 2023-08-09T14:15:51.612 INFO:teuthology.orchestra.run.smithi101.stderr:69 bytes copied, 2.208e-05 s, 3.1 MB/s 2023-08-09T14:15:51.613 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-09T14:15:51.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 Processor -- start 2023-08-09T14:15:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 -- start start 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79640b2130 0x7f79640d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79640d0760 con 0x7f79640b04f0 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79640ce7f0 con 0x7f796415d5d0 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.765+0000 7f7969372700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79640b00d0 con 0x7f79640b2130 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79627fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79640b2130 0x7f79640d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79637fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79640b04f0 0x7f79640b0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56784/0 (socket says 172.21.15.5:56784) 2023-08-09T14:15:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79637fe700 1 -- 172.21.15.5:0/3106098767 learned_addr learned my addr 172.21.15.5:0/3106098767 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79627fc700 1 -- 172.21.15.5:0/3106098767 >> v1:172.21.15.101:6789/0 conn(0x7f796415d5d0 legacy=0x7f79640d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79627fc700 1 -- 172.21.15.5:0/3106098767 >> v1:172.21.15.5:6789/0 conn(0x7f79640b04f0 legacy=0x7f79640b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79627fc700 1 -- 172.21.15.5:0/3106098767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79640afd60 con 0x7f79640b2130 2023-08-09T14:15:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f7961ffb700 1 -- 172.21.15.5:0/3106098767 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808447152 0 0) 0x7f79640d0760 con 0x7f79640b04f0 2023-08-09T14:15:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f79627fc700 1 --2- 172.21.15.5:0/3106098767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79640b2130 0x7f79640d16a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7958009840 tx=0x7f7958009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580ea188f0e52d86 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f7961ffb700 1 -- 172.21.15.5:0/3106098767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958011830 con 0x7f79640b2130 2023-08-09T14:15:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f7961ffb700 1 -- 172.21.15.5:0/3106098767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958011990 con 0x7f79640b2130 2023-08-09T14:15:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.766+0000 7f7961ffb700 1 -- 172.21.15.5:0/3106098767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958011d20 con 0x7f79640b2130 2023-08-09T14:15:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 -- 172.21.15.5:0/3106098767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79640b2130 msgr2=0x7f79640d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 --2- 172.21.15.5:0/3106098767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79640b2130 0x7f79640d16a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7958009840 tx=0x7f7958009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 -- 172.21.15.5:0/3106098767 shutdown_connections 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 --2- 172.21.15.5:0/3106098767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79640b2130 0x7f79640d16a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 -- 172.21.15.5:0/3106098767 >> 172.21.15.5:0/3106098767 conn(0x7f79640d3090 msgr2=0x7f79640d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 -- 172.21.15.5:0/3106098767 shutdown_connections 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.767+0000 7f7969372700 1 -- 172.21.15.5:0/3106098767 wait complete. 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.768+0000 7f7969372700 1 Processor -- start 2023-08-09T14:15:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.768+0000 7f7969372700 1 -- start start 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79640b04f0 0x7f796415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79640b2130 0x7f79640c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79640b6400 con 0x7f796415d5d0 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79640b6660 con 0x7f79640b04f0 2023-08-09T14:15:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7969372700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79640b6940 con 0x7f79640b2130 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f79637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f79637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43374/0 (socket says 172.21.15.5:43374) 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f79637fe700 1 -- 172.21.15.5:0/1258874576 learned_addr learned my addr 172.21.15.5:0/1258874576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f7962ffd700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79640b04f0 0x7f796415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.769+0000 7f79627fc700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79640b2130 0x7f79640c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 -- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79640b2130 msgr2=0x7f79640c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79640b2130 0x7f79640c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 -- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79640b04f0 msgr2=0x7f796415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79640b04f0 0x7f796415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 -- 172.21.15.5:0/1258874576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580094a0 con 0x7f796415d5d0 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f79637fe700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f795c00cba0 tx=0x7f795c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00aaa0 con 0x7f796415d5d0 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00ac20 con 0x7f796415d5d0 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0070d0 con 0x7f796415d5d0 2023-08-09T14:15:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79640b6c20 con 0x7f796415d5d0 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.770+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79640b71e0 con 0x7f796415d5d0 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.771+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7964074600 con 0x7f796415d5d0 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.771+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f795c007230 con 0x7f796415d5d0 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.772+0000 7f794b7fe700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 0x7f795006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.772+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f795c087fe0 con 0x7f796415d5d0 2023-08-09T14:15:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.772+0000 7f7962ffd700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 0x7f795006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.772+0000 7f7962ffd700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 0x7f795006c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7954000f60 tx=0x7f7954009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.776+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f795c0536d0 con 0x7f796415d5d0 2023-08-09T14:15:51.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.976+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79640d08f0 con 0x7f796415d5d0 2023-08-09T14:15:51.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.977+0000 7f794b7fe700 1 -- 172.21.15.5:0/1258874576 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f795c018020 con 0x7f796415d5d0 2023-08-09T14:15:51.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:51.980 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:51.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 msgr2=0x7f795006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 0x7f795006c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7954000f60 tx=0x7f7954009040 comp rx=0 tx=0).stop 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 msgr2=0x7f79640b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f795c00cba0 tx=0x7f795c00ceb0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 shutdown_connections 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f795006a0e0 0x7f795006c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f796415d5d0 0x7f79640b5ec0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f79640b04f0 0x7f796415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 --2- 172.21.15.5:0/1258874576 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f79640b2130 0x7f79640c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:51.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 >> 172.21.15.5:0/1258874576 conn(0x7f79640d3090 msgr2=0x7f796415d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:51.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 shutdown_connections 2023-08-09T14:15:51.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:51.979+0000 7f7969372700 1 -- 172.21.15.5:0/1258874576 wait complete. 2023-08-09T14:15:51.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:51.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.121+0000 7f751d7ae700 1 Processor -- start 2023-08-09T14:15:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.121+0000 7f751d7ae700 1 -- start start 2023-08-09T14:15:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.122+0000 7f751d7ae700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.122+0000 7f751d7ae700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.122+0000 7f751d7ae700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751806ab50 con 0x7f751815d3a0 2023-08-09T14:15:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.122+0000 7f751d7ae700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180cd6c0 con 0x7f75180cd1c0 2023-08-09T14:15:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.122+0000 7f751d7ae700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180715a0 con 0x7f751806a1c0 2023-08-09T14:15:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75167fc700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:32964/0 (socket says 172.21.15.5:32964) 2023-08-09T14:15:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75167fc700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60424/0 (socket says 172.21.15.5:60424) 2023-08-09T14:15:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 -- 172.21.15.5:0/4171943119 learned_addr learned my addr 172.21.15.5:0/4171943119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f7516ffd700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f751815d3a0 0x7f75180cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38140/0 (socket says 172.21.15.5:38140) 2023-08-09T14:15:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 -- 172.21.15.5:0/4171943119 >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 msgr2=0x7f75180af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 --2- 172.21.15.5:0/4171943119 >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 -- 172.21.15.5:0/4171943119 >> v1:172.21.15.101:6789/0 conn(0x7f751815d3a0 legacy=0x7f75180cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 -- 172.21.15.5:0/4171943119 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180712a0 con 0x7f751806a1c0 2023-08-09T14:15:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75167fc700 1 --2- 172.21.15.5:0/4171943119 >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f75177fe700 1 --2- 172.21.15.5:0/4171943119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7510009e50 tx=0x7f751000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd8cc6767495b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f7515ffb700 1 -- 172.21.15.5:0/4171943119 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000e070 con 0x7f751806a1c0 2023-08-09T14:15:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f7515ffb700 1 -- 172.21.15.5:0/4171943119 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000b910 con 0x7f751806a1c0 2023-08-09T14:15:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.123+0000 7f7515ffb700 1 -- 172.21.15.5:0/4171943119 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000bcc0 con 0x7f751806a1c0 2023-08-09T14:15:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 -- 172.21.15.5:0/4171943119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 msgr2=0x7f751806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 --2- 172.21.15.5:0/4171943119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7510009e50 tx=0x7f751000b330 comp rx=0 tx=0).stop 2023-08-09T14:15:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 -- 172.21.15.5:0/4171943119 shutdown_connections 2023-08-09T14:15:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 --2- 172.21.15.5:0/4171943119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f751806a1c0 0x7f751806a610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 --2- 172.21.15.5:0/4171943119 >> v2:172.21.15.101:3300/0 conn(0x7f75180cd1c0 0x7f75180af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 -- 172.21.15.5:0/4171943119 >> 172.21.15.5:0/4171943119 conn(0x7f75180b1970 msgr2=0x7f75180b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 -- 172.21.15.5:0/4171943119 shutdown_connections 2023-08-09T14:15:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.124+0000 7f751d7ae700 1 -- 172.21.15.5:0/4171943119 wait complete. 2023-08-09T14:15:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.125+0000 7f751d7ae700 1 Processor -- start 2023-08-09T14:15:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.125+0000 7f751d7ae700 1 -- start start 2023-08-09T14:15:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f75180cd1c0 0x7f75180b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f751815d3a0 0x7f75181f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b3a60 con 0x7f751806a1c0 2023-08-09T14:15:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b2f20 con 0x7f751815d3a0 2023-08-09T14:15:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f751d7ae700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b31c0 con 0x7f75180cd1c0 2023-08-09T14:15:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43384/0 (socket says 172.21.15.5:43384) 2023-08-09T14:15:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 -- 172.21.15.5:0/739874447 learned_addr learned my addr 172.21.15.5:0/739874447 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f75167fc700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f75180cd1c0 0x7f75180b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f75177fe700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f751815d3a0 0x7f75181f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 -- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f75180cd1c0 msgr2=0x7f75180b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f75180cd1c0 0x7f75180b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 -- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f751815d3a0 msgr2=0x7f75181f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f751815d3a0 0x7f75181f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.126+0000 7f7516ffd700 1 -- 172.21.15.5:0/739874447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080094a0 con 0x7f751806a1c0 2023-08-09T14:15:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f7516ffd700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c500 tx=0x7f750c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c005cb0 con 0x7f751806a1c0 2023-08-09T14:15:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7510009b30 con 0x7f751806a1c0 2023-08-09T14:15:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c005e10 con 0x7f751806a1c0 2023-08-09T14:15:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0072d0 con 0x7f751806a1c0 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.127+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75180b3780 con 0x7f751806a1c0 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.128+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75180ae8d0 con 0x7f751806a1c0 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.128+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f750c007430 con 0x7f751806a1c0 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.129+0000 7f74ff7fe700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 0x7f750406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.129+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f750c087580 con 0x7f751806a1c0 2023-08-09T14:15:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.129+0000 7f75167fc700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 0x7f750406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.129+0000 7f75167fc700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 0x7f750406c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7518160740 tx=0x7f7508009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.133+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f750c052d30 con 0x7f751806a1c0 2023-08-09T14:15:52.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.329+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f751806ab50 con 0x7f751806a1c0 2023-08-09T14:15:52.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.330+0000 7f74ff7fe700 1 -- 172.21.15.5:0/739874447 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f751806ab50 con 0x7f751806a1c0 2023-08-09T14:15:52.333 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:52.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 msgr2=0x7f750406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 0x7f750406c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7518160740 tx=0x7f7508009210 comp rx=0 tx=0).stop 2023-08-09T14:15:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 msgr2=0x7f75180b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c500 tx=0x7f750c00c810 comp rx=0 tx=0).stop 2023-08-09T14:15:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 shutdown_connections 2023-08-09T14:15:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f750406a0e0 0x7f750406c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f751815d3a0 0x7f75181f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751806a1c0 0x7f75180b5370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 --2- 172.21.15.5:0/739874447 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f75180cd1c0 0x7f75180b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 >> 172.21.15.5:0/739874447 conn(0x7f75180b1970 msgr2=0x7f75180ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 shutdown_connections 2023-08-09T14:15:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.332+0000 7f751d7ae700 1 -- 172.21.15.5:0/739874447 wait complete. 2023-08-09T14:15:52.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:52.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.472+0000 7f45fa10c700 1 Processor -- start 2023-08-09T14:15:52.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.472+0000 7f45fa10c700 1 -- start start 2023-08-09T14:15:52.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45fa10c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 0x7f45f40af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45fa10c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45f40cd1c0 0x7f45f40cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45fa10c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40715a0 con 0x7f45f406a1c0 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45fa10c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40cd6c0 con 0x7f45f40cd1c0 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45fa10c700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40712a0 con 0x7f45f415d3a0 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45f2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45f40cd1c0 0x7f45f40cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45f3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45f406a1c0 0x7f45f4160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56812/0 (socket says 172.21.15.5:56812) 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.473+0000 7f45f3fff700 1 -- 172.21.15.5:0/3259517983 learned_addr learned my addr 172.21.15.5:0/3259517983 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f37fe700 1 --2- 172.21.15.5:0/3259517983 >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 0x7f45f40af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3259517983 >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 msgr2=0x7f45f40af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f2ffd700 1 --2- 172.21.15.5:0/3259517983 >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 0x7f45f40af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3259517983 >> v1:172.21.15.5:6789/0 conn(0x7f45f406a1c0 legacy=0x7f45f4160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f27fc700 1 -- 172.21.15.5:0/3259517983 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924886988 0 0) 0x7f45f40715a0 con 0x7f45f406a1c0 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3259517983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40cf570 con 0x7f45f40cd1c0 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f37fe700 1 --2- 172.21.15.5:0/3259517983 >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 0x7f45f40af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f2ffd700 1 --2- 172.21.15.5:0/3259517983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f40cda00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c900 tx=0x7f45e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7a18ebec0e633e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f27fc700 1 -- 172.21.15.5:0/3259517983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011830 con 0x7f45f40cd1c0 2023-08-09T14:15:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f27fc700 1 -- 172.21.15.5:0/3259517983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8011990 con 0x7f45f40cd1c0 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45f27fc700 1 -- 172.21.15.5:0/3259517983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011d20 con 0x7f45f40cd1c0 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.474+0000 7f45fa10c700 1 -- 172.21.15.5:0/3259517983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 msgr2=0x7f45f40cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3259517983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f40cda00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c900 tx=0x7f45e8009b20 comp rx=0 tx=0).stop 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 -- 172.21.15.5:0/3259517983 shutdown_connections 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3259517983 >> v2:172.21.15.101:3300/0 conn(0x7f45f415d3a0 0x7f45f40af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3259517983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f40cda00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 -- 172.21.15.5:0/3259517983 >> 172.21.15.5:0/3259517983 conn(0x7f45f40b1970 msgr2=0x7f45f40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 -- 172.21.15.5:0/3259517983 shutdown_connections 2023-08-09T14:15:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.475+0000 7f45fa10c700 1 -- 172.21.15.5:0/3259517983 wait complete. 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.476+0000 7f45fa10c700 1 Processor -- start 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.476+0000 7f45fa10c700 1 -- start start 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f45f406a1c0 0x7f45f41f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f45f415d3a0 0x7f45f4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41f6cd0 con 0x7f45f40cd1c0 2023-08-09T14:15:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40b3c60 con 0x7f45f406a1c0 2023-08-09T14:15:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41f2be0 con 0x7f45f415d3a0 2023-08-09T14:15:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43400/0 (socket says 172.21.15.5:43400) 2023-08-09T14:15:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3555233661 learned_addr learned my addr 172.21.15.5:0/3555233661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f3fff700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f45f415d3a0 0x7f45f4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f37fe700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f45f406a1c0 0x7f45f41f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f45f415d3a0 msgr2=0x7f45f4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f45f415d3a0 0x7f45f4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f45f406a1c0 msgr2=0x7f45f41f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f45f406a1c0 0x7f45f41f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 -- 172.21.15.5:0/3555233661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80094a0 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45f2ffd700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45e8000c00 tx=0x7f45e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80038a0 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e801f070 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f41f2ea0 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.477+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8003c40 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.478+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41f3460 con 0x7f45f40cd1c0 2023-08-09T14:15:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.478+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40b3a30 con 0x7f45f40cd1c0 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.479+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45e8026480 con 0x7f45f40cd1c0 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.479+0000 7f45dbfff700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.479+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45e8021070 con 0x7f45f40cd1c0 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.479+0000 7f45f37fe700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.480+0000 7f45f37fe700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 0x7f45e006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.484+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f45f40b3a30 con 0x7f45f40cd1c0 2023-08-09T14:15:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.682+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45f40b3a30 con 0x7f45f40cd1c0 2023-08-09T14:15:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.682+0000 7f45dbfff700 1 -- 172.21.15.5:0/3555233661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45f40b3a30 con 0x7f45f40cd1c0 2023-08-09T14:15:52.685 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 msgr2=0x7f45e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 0x7f45e006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4008040 comp rx=0 tx=0).stop 2023-08-09T14:15:52.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 msgr2=0x7f45f41f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45e8000c00 tx=0x7f45e8004750 comp rx=0 tx=0).stop 2023-08-09T14:15:52.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 shutdown_connections 2023-08-09T14:15:52.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f45f415d3a0 0x7f45f4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f45f406a1c0 0x7f45f41f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 --2- 172.21.15.5:0/3555233661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f40cd1c0 0x7f45f41f26a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 >> 172.21.15.5:0/3555233661 conn(0x7f45f40b1970 msgr2=0x7f45f40b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 shutdown_connections 2023-08-09T14:15:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.684+0000 7f45fa10c700 1 -- 172.21.15.5:0/3555233661 wait complete. 2023-08-09T14:15:52.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.825+0000 7f2599cfe700 1 Processor -- start 2023-08-09T14:15:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.825+0000 7f2599cfe700 1 -- start start 2023-08-09T14:15:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2599cfe700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f259415f640 0x7f25940cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2599cfe700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259415fa50 con 0x7f25940b6170 2023-08-09T14:15:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2599cfe700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25940cf500 con 0x7f25940b2ff0 2023-08-09T14:15:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2599cfe700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259415fc90 con 0x7f259415f640 2023-08-09T14:15:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f25937fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25940b6170 0x7f25940b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56822/0 (socket says 172.21.15.5:56822) 2023-08-09T14:15:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f25937fe700 1 -- 172.21.15.5:0/3677740069 learned_addr learned my addr 172.21.15.5:0/3677740069 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2593fff700 1 --2- 172.21.15.5:0/3677740069 >> v2:172.21.15.101:3300/0 conn(0x7f259415f640 0x7f25940cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933611978 0 0) 0x7f2584001110 con 0x7f25940b6170 2023-08-09T14:15:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f257c0035b0 con 0x7f25940b6170 2023-08-09T14:15:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2593fff700 1 -- 172.21.15.5:0/3677740069 >> v1:172.21.15.101:6789/0 conn(0x7f25940b2ff0 legacy=0x7f2594151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2593fff700 1 -- 172.21.15.5:0/3677740069 >> v1:172.21.15.5:6789/0 conn(0x7f25940b6170 legacy=0x7f25940b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4243112773 0 0) 0x7f257c0035b0 con 0x7f25940b6170 2023-08-09T14:15:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2593fff700 1 -- 172.21.15.5:0/3677740069 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259415c670 con 0x7f259415f640 2023-08-09T14:15:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.826+0000 7f2593fff700 1 --2- 172.21.15.5:0/3677740069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25940cb4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f258c009d90 tx=0x7f258c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75606980440792f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00e070 con 0x7f259415f640 2023-08-09T14:15:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c003a20 con 0x7f259415f640 2023-08-09T14:15:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f25927fc700 1 -- 172.21.15.5:0/3677740069 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584001800 con 0x7f259415f640 2023-08-09T14:15:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 -- 172.21.15.5:0/3677740069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 msgr2=0x7f25940cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 --2- 172.21.15.5:0/3677740069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25940cb4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f258c009d90 tx=0x7f258c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 -- 172.21.15.5:0/3677740069 shutdown_connections 2023-08-09T14:15:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 --2- 172.21.15.5:0/3677740069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25940cb4b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 -- 172.21.15.5:0/3677740069 >> 172.21.15.5:0/3677740069 conn(0x7f259406dec0 msgr2=0x7f259406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 -- 172.21.15.5:0/3677740069 shutdown_connections 2023-08-09T14:15:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.827+0000 7f2599cfe700 1 -- 172.21.15.5:0/3677740069 wait complete. 2023-08-09T14:15:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.828+0000 7f2599cfe700 1 Processor -- start 2023-08-09T14:15:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 -- start start 2023-08-09T14:15:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f25940b2ff0 0x7f25940c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25941f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259415b0f0 con 0x7f25940b6170 2023-08-09T14:15:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25940c8b10 con 0x7f259415f640 2023-08-09T14:15:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2599cfe700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940c8df0 con 0x7f25940b2ff0 2023-08-09T14:15:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2592ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.829+0000 7f2592ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43414/0 (socket says 172.21.15.5:43414) 2023-08-09T14:15:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 -- 172.21.15.5:0/1496030704 learned_addr learned my addr 172.21.15.5:0/1496030704 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f25937fe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f25940b2ff0 0x7f25940c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2593fff700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25941f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 -- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f25940b2ff0 msgr2=0x7f25940c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f25940b2ff0 0x7f25940c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 -- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 msgr2=0x7f25941f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25941f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 -- 172.21.15.5:0/1496030704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c009a70 con 0x7f25940b6170 2023-08-09T14:15:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2592ffd700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f258800c700 tx=0x7f258800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880052d0 con 0x7f25940b6170 2023-08-09T14:15:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588005430 con 0x7f25940b6170 2023-08-09T14:15:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25940c90d0 con 0x7f25940b6170 2023-08-09T14:15:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588003880 con 0x7f25940b6170 2023-08-09T14:15:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.830+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25940c9690 con 0x7f25940b6170 2023-08-09T14:15:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.831+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25940cf970 con 0x7f25940b6170 2023-08-09T14:15:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.832+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25880039e0 con 0x7f25940b6170 2023-08-09T14:15:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.832+0000 7f257bfff700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 0x7f258006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.832+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25880877e0 con 0x7f25940b6170 2023-08-09T14:15:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.832+0000 7f25937fe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 0x7f258006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.833+0000 7f25937fe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 0x7f258006c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2584004a60 tx=0x7f25840012f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:52.837+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f25940cf970 con 0x7f25940b6170 2023-08-09T14:15:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.038+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25940cf970 con 0x7f25940b6170 2023-08-09T14:15:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.038+0000 7f257bfff700 1 -- 172.21.15.5:0/1496030704 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25940cf970 con 0x7f25940b6170 2023-08-09T14:15:53.041 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 msgr2=0x7f258006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 0x7f258006c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2584004a60 tx=0x7f25840012f0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 msgr2=0x7f25940c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f258800c700 tx=0x7f258800ca10 comp rx=0 tx=0).stop 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 shutdown_connections 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f258006a0e0 0x7f258006c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f259415f640 0x7f25941f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f25940b2ff0 0x7f25940c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 --2- 172.21.15.5:0/1496030704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25940b6170 0x7f25940c8470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 >> 172.21.15.5:0/1496030704 conn(0x7f259406dec0 msgr2=0x7f25940d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 shutdown_connections 2023-08-09T14:15:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.040+0000 7f2599cfe700 1 -- 172.21.15.5:0/1496030704 wait complete. 2023-08-09T14:15:53.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.181+0000 7f08b8888700 1 Processor -- start 2023-08-09T14:15:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.181+0000 7f08b8888700 1 -- start start 2023-08-09T14:15:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.181+0000 7f08b8888700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f08b40ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.181+0000 7f08b8888700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b40cc1f0 con 0x7f08b406db00 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b8888700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b406a1c0 con 0x7f08b415b130 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b8888700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b406af60 con 0x7f08b40cbda0 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b1d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08b406db00 0x7f08b40b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56836/0 (socket says 172.21.15.5:56836) 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b1d9b700 1 -- 172.21.15.5:0/991274060 learned_addr learned my addr 172.21.15.5:0/991274060 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269112323 0 0) 0x7f08b40cc1f0 con 0x7f08b406db00 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b2d9d700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f08b40ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f089c0035b0 con 0x7f08b406db00 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464316183 0 0) 0x7f089c0035b0 con 0x7f08b406db00 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 msgr2=0x7f08b40ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f08b40ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 >> v1:172.21.15.101:6789/0 conn(0x7f08b415b130 legacy=0x7f08b406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40cc480 con 0x7f08b406db00 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f08a4001670 con 0x7f08b406db00 2023-08-09T14:15:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 >> v1:172.21.15.5:6789/0 conn(0x7f08b406db00 legacy=0x7f08b40b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089c003a30 0x7f089c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f089c004850 0x7f089c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f089c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c00bac0 con 0x7f089c003a30 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c00bc00 con 0x7f089c004850 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089c00bdc0 con 0x7f08b40cbda0 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b259c700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089c003a30 0x7f089c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.182+0000 7f08b1d9b700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f089c004850 0x7f089c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b2d9d700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f089c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 -- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 msgr2=0x7f089c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f089c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 -- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f089c004850 msgr2=0x7f089c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f089c004850 0x7f089c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 -- 172.21.15.5:0/991274060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0035b0 con 0x7f089c003a30 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b2d9d700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f08b40cbda0 0x7f089c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b259c700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089c003a30 0x7f089c003e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007fd0 tx=0x7f089c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547df72fe1e86124 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80052d0 con 0x7f089c003a30 2023-08-09T14:15:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8005470 con 0x7f089c003a30 2023-08-09T14:15:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.183+0000 7f08b159a700 1 -- 172.21.15.5:0/991274060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80038c0 con 0x7f089c003a30 2023-08-09T14:15:53.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 -- 172.21.15.5:0/991274060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089c003a30 msgr2=0x7f089c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 --2- 172.21.15.5:0/991274060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089c003a30 0x7f089c003e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007fd0 tx=0x7f089c005880 comp rx=0 tx=0).stop 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b2d9d700 1 -- 172.21.15.5:0/991274060 reap_dead start 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 -- 172.21.15.5:0/991274060 shutdown_connections 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 -- 172.21.15.5:0/991274060 >> 172.21.15.5:0/991274060 conn(0x7f08b40b1970 msgr2=0x7f08b40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 -- 172.21.15.5:0/991274060 shutdown_connections 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.184+0000 7f08b8888700 1 -- 172.21.15.5:0/991274060 wait complete. 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.185+0000 7f08b8888700 1 Processor -- start 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.185+0000 7f08b8888700 1 -- start start 2023-08-09T14:15:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f089c003a30 0x7f08b40c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08b414fe10 0x7f08b41502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40c7f30 con 0x7f08b40c6e70 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4150800 con 0x7f08b414fe10 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b8888700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40c8480 con 0x7f089c003a30 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43434/0 (socket says 172.21.15.5:43434) 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 -- 172.21.15.5:0/4104709240 learned_addr learned my addr 172.21.15.5:0/4104709240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b259c700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f089c003a30 0x7f08b40c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b2d9d700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08b414fe10 0x7f08b41502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 -- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f089c003a30 msgr2=0x7f08b40c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f089c003a30 0x7f08b40c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 -- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08b414fe10 msgr2=0x7f08b41502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08b414fe10 0x7f08b41502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 -- 172.21.15.5:0/4104709240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40c7970 con 0x7f08b40c6e70 2023-08-09T14:15:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.186+0000 7f08b1d9b700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08a40072c0 tx=0x7f08a4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.187+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40077a0 con 0x7f08b40c6e70 2023-08-09T14:15:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.187+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400f8d0 con 0x7f08b40c6e70 2023-08-09T14:15:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.187+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b40c7c50 con 0x7f08b40c6e70 2023-08-09T14:15:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.187+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400fc80 con 0x7f08b40c6e70 2023-08-09T14:15:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.187+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b4153a00 con 0x7f08b40c6e70 2023-08-09T14:15:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.188+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b40c82e0 con 0x7f08b40c6e70 2023-08-09T14:15:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.188+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08a401d460 con 0x7f08b40c6e70 2023-08-09T14:15:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.188+0000 7f08a2ffd700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 0x7f089406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.189+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08a4088590 con 0x7f08b40c6e70 2023-08-09T14:15:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.189+0000 7f08b259c700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 0x7f089406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.189+0000 7f08b259c700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 0x7f089406c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007fd0 tx=0x7f08a8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.194+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f08b40c82e0 con 0x7f08b40c6e70 2023-08-09T14:15:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.392+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08b40c82e0 con 0x7f08b40c6e70 2023-08-09T14:15:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.393+0000 7f08a2ffd700 1 -- 172.21.15.5:0/4104709240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08b40c82e0 con 0x7f08b40c6e70 2023-08-09T14:15:53.395 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 msgr2=0x7f089406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 0x7f089406c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007fd0 tx=0x7f08a8009030 comp rx=0 tx=0).stop 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 msgr2=0x7f08b40c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08a40072c0 tx=0x7f08a4007680 comp rx=0 tx=0).stop 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 shutdown_connections 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f089406a0e0 0x7f089406c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f08b414fe10 0x7f08b41502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f089c003a30 0x7f08b40c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 --2- 172.21.15.5:0/4104709240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b40c6e70 0x7f08b40c72f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 >> 172.21.15.5:0/4104709240 conn(0x7f08b40b1970 msgr2=0x7f08b415d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 shutdown_connections 2023-08-09T14:15:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.395+0000 7f08b8888700 1 -- 172.21.15.5:0/4104709240 wait complete. 2023-08-09T14:15:53.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.532+0000 7fdfc38bf700 1 Processor -- start 2023-08-09T14:15:53.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.532+0000 7fdfc38bf700 1 -- start start 2023-08-09T14:15:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc38bf700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fdfbc06a640 0x7fdfbc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc38bf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0ce050 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc38bf700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc06e850 con 0x7fdfbc15d400 2023-08-09T14:15:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc38bf700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc06aad0 con 0x7fdfbc06a640 2023-08-09T14:15:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc0e5a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdfbc06a1c0 0x7fdfbc0cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56856/0 (socket says 172.21.15.5:56856) 2023-08-09T14:15:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc0e5a700 1 -- 172.21.15.5:0/2503925147 learned_addr learned my addr 172.21.15.5:0/2503925147 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> v2:172.21.15.101:3300/0 conn(0x7fdfbc06a640 0x7fdfbc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.533+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33731860 0 0) 0x7fdfbc0ce050 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa80035b0 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110062874 0 0) 0x7fdfbc06e850 con 0x7fdfbc15d400 2023-08-09T14:15:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfbc0ce050 con 0x7fdfbc15d400 2023-08-09T14:15:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384720450 0 0) 0x7fdfa80035b0 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 >> v2:172.21.15.101:3300/0 conn(0x7fdfbc06a640 msgr2=0x7fdfbc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 --2- 172.21.15.5:0/2503925147 >> v2:172.21.15.101:3300/0 conn(0x7fdfbc06a640 0x7fdfbc0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 >> v1:172.21.15.101:6789/0 conn(0x7fdfbc15d400 legacy=0x7fdfbc0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0cf7b0 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fdfb8001670 con 0x7fdfbc06a1c0 2023-08-09T14:15:53.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> v2:172.21.15.101:3300/0 conn(0x7fdfbc06a640 0x7fdfbc0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:15:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 >> v1:172.21.15.5:6789/0 conn(0x7fdfbc06a1c0 legacy=0x7fdfbc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfa8003be0 0x7fdfa8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8004850 0x7fdfa8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 0x7fdfa800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc06aad0 con 0x7fdfa8005210 2023-08-09T14:15:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800c0e0 con 0x7fdfa8004850 2023-08-09T14:15:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800c2a0 con 0x7fdfa8003be0 2023-08-09T14:15:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 0x7fdfa800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc165b700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfa8003be0 0x7fdfa8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc0e5a700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8004850 0x7fdfa8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfa8003be0 msgr2=0x7fdfa8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfa8003be0 0x7fdfa8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8004850 msgr2=0x7fdfa8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8004850 0x7fdfa8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/2503925147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80035b0 con 0x7fdfa8005210 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/2503925147 reap_dead start 2023-08-09T14:15:53.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.534+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 0x7fdfa800ba10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e350 tx=0x7fdfa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e21ac2f10f3725 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400edf0 con 0x7fdfa8005210 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400f040 con 0x7fdfa8005210 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfb3fff700 1 -- 172.21.15.5:0/2503925147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40146c0 con 0x7fdfa8005210 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 -- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 msgr2=0x7fdfa800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 0x7fdfa800ba10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e350 tx=0x7fdfa8005880 comp rx=0 tx=0).stop 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 -- 172.21.15.5:0/2503925147 shutdown_connections 2023-08-09T14:15:53.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/2503925147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa8005210 0x7fdfa800ba10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 -- 172.21.15.5:0/2503925147 >> 172.21.15.5:0/2503925147 conn(0x7fdfbc0b1900 msgr2=0x7fdfbc0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 -- 172.21.15.5:0/2503925147 shutdown_connections 2023-08-09T14:15:53.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.535+0000 7fdfc38bf700 1 -- 172.21.15.5:0/2503925147 wait complete. 2023-08-09T14:15:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.537+0000 7fdfc38bf700 1 Processor -- start 2023-08-09T14:15:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.537+0000 7fdfc38bf700 1 -- start start 2023-08-09T14:15:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8005210 0x7fdfbc150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 0x7fdfbc0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1507c0 con 0x7fdfbc160920 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0cbdb0 con 0x7fdfa8005210 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b2b70 con 0x7fdfbc0cb3f0 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43456/0 (socket says 172.21.15.5:43456) 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/1408208119 learned_addr learned my addr 172.21.15.5:0/1408208119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc165b700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8005210 0x7fdfbc150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc0e5a700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 0x7fdfbc0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 msgr2=0x7fdfbc0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 0x7fdfbc0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8005210 msgr2=0x7fdfbc150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8005210 0x7fdfbc150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 -- 172.21.15.5:0/1408208119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc161310 con 0x7fdfbc160920 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc0e5a700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 0x7fdfbc0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc1e5c700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae9f0 tx=0x7fdfb4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004450 con 0x7fdfbc160920 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40045f0 con 0x7fdfbc160920 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc15ef70 con 0x7fdfbc160920 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4014480 con 0x7fdfbc160920 2023-08-09T14:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.539+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc15f530 con 0x7fdfbc160920 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.540+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc074600 con 0x7fdfbc160920 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.540+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdfb4023070 con 0x7fdfbc160920 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.541+0000 7fdfb1ffb700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 0x7fdfa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.541+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfb4089be0 con 0x7fdfbc160920 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.541+0000 7fdfc165b700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 0x7fdfa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.541+0000 7fdfc165b700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 0x7fdfa006c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfac000c00 tx=0x7fdfac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.545+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdfb4055360 con 0x7fdfbc160920 2023-08-09T14:15:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.746+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfbc071530 con 0x7fdfbc160920 2023-08-09T14:15:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.747+0000 7fdfb1ffb700 1 -- 172.21.15.5:0/1408208119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fdfb4018090 con 0x7fdfbc160920 2023-08-09T14:15:53.749 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:53.749 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 msgr2=0x7fdfa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 0x7fdfa006c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfac000c00 tx=0x7fdfac009040 comp rx=0 tx=0).stop 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 msgr2=0x7fdfbc160dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae9f0 tx=0x7fdfb4009750 comp rx=0 tx=0).stop 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 shutdown_connections 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fdfa006a0e0 0x7fdfa006c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfbc160920 0x7fdfbc160dd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fdfa8005210 0x7fdfbc150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 --2- 172.21.15.5:0/1408208119 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fdfbc0cb3f0 0x7fdfbc0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 >> 172.21.15.5:0/1408208119 conn(0x7fdfbc0b1900 msgr2=0x7fdfbc15c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 shutdown_connections 2023-08-09T14:15:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.749+0000 7fdfc38bf700 1 -- 172.21.15.5:0/1408208119 wait complete. 2023-08-09T14:15:53.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:53.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.891+0000 7fcaac18d700 1 Processor -- start 2023-08-09T14:15:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.891+0000 7fcaac18d700 1 -- start start 2023-08-09T14:15:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaac18d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaa40cc960 0x7fcaa406c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaac18d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40b0420 0x7fcaa40d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaac18d700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa406bce0 con 0x7fcaa40ccd40 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaac18d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406cb50 con 0x7fcaa40cc960 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaac18d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa406ccf0 con 0x7fcaa40b0420 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaa40cc960 0x7fcaa406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaa40cc960 0x7fcaa406c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43460/0 (socket says 172.21.15.5:43460) 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 -- 172.21.15.5:0/3739906414 learned_addr learned my addr 172.21.15.5:0/3739906414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaaa72a700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40b0420 0x7fcaa40d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 -- 172.21.15.5:0/3739906414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40b0420 msgr2=0x7fcaa40d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40b0420 0x7fcaa40d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 -- 172.21.15.5:0/3739906414 >> v1:172.21.15.101:6789/0 conn(0x7fcaa40ccd40 legacy=0x7fcaa4160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 -- 172.21.15.5:0/3739906414 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa406c210 con 0x7fcaa40cc960 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.892+0000 7fcaa9f29700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40cc960 0x7fcaa406c610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00098f0 tx=0x7fcaa0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e5ad308806a73d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaa8f27700 1 -- 172.21.15.5:0/3739906414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0011830 con 0x7fcaa40cc960 2023-08-09T14:15:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaa8f27700 1 -- 172.21.15.5:0/3739906414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0011990 con 0x7fcaa40cc960 2023-08-09T14:15:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaa8f27700 1 -- 172.21.15.5:0/3739906414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0011d20 con 0x7fcaa40cc960 2023-08-09T14:15:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 -- 172.21.15.5:0/3739906414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40cc960 msgr2=0x7fcaa406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40cc960 0x7fcaa406c610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00098f0 tx=0x7fcaa0009c00 comp rx=0 tx=0).stop 2023-08-09T14:15:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 -- 172.21.15.5:0/3739906414 shutdown_connections 2023-08-09T14:15:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40b0420 0x7fcaa40d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 --2- 172.21.15.5:0/3739906414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40cc960 0x7fcaa406c610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.893+0000 7fcaac18d700 1 -- 172.21.15.5:0/3739906414 >> 172.21.15.5:0/3739906414 conn(0x7fcaa406dec0 msgr2=0x7fcaa406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.894+0000 7fcaac18d700 1 -- 172.21.15.5:0/3739906414 shutdown_connections 2023-08-09T14:15:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.894+0000 7fcaac18d700 1 -- 172.21.15.5:0/3739906414 wait complete. 2023-08-09T14:15:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.895+0000 7fcaac18d700 1 Processor -- start 2023-08-09T14:15:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.895+0000 7fcaac18d700 1 -- start start 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fcaa40cc960 0x7fcaa40c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40ccd40 0x7fcaa40b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b3260 con 0x7fcaa40b0420 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b21c0 con 0x7fcaa40cc960 2023-08-09T14:15:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaac18d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b24a0 con 0x7fcaa40ccd40 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaa9f29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaa9f29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43466/0 (socket says 172.21.15.5:43466) 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.896+0000 7fcaa9f29700 1 -- 172.21.15.5:0/4047789241 learned_addr learned my addr 172.21.15.5:0/4047789241 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9728700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fcaa40cc960 0x7fcaa40c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaaa72a700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40ccd40 0x7fcaa40b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 -- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40ccd40 msgr2=0x7fcaa40b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40ccd40 0x7fcaa40b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 -- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fcaa40cc960 msgr2=0x7fcaa40c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fcaa40cc960 0x7fcaa40c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 -- 172.21.15.5:0/4047789241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa0009550 con 0x7fcaa40b0420 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaa9f29700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009c40 tx=0x7fcaa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0004510 con 0x7fcaa40b0420 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa001e070 con 0x7fcaa40b0420 2023-08-09T14:15:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40b2780 con 0x7fcaa40b0420 2023-08-09T14:15:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00038e0 con 0x7fcaa40b0420 2023-08-09T14:15:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.897+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40b2d40 con 0x7fcaa40b0420 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.898+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40b2f30 con 0x7fcaa40b0420 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.899+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcaa0003a40 con 0x7fcaa40b0420 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.899+0000 7fca9a7fc700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 0x7fca8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.899+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcaa0089360 con 0x7fcaa40b0420 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.899+0000 7fcaa9728700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 0x7fca8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.900+0000 7fcaa9728700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 0x7fca8806c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40c99a0 tx=0x7fca94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:53.904+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcaa0054a60 con 0x7fcaa40b0420 2023-08-09T14:15:54.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.106+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcaa406fe90 con 0x7fcaa40b0420 2023-08-09T14:15:54.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.107+0000 7fca9a7fc700 1 -- 172.21.15.5:0/4047789241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcaa0058080 con 0x7fcaa40b0420 2023-08-09T14:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:54.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 msgr2=0x7fca8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 0x7fca8806c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40c99a0 tx=0x7fca94009040 comp rx=0 tx=0).stop 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 msgr2=0x7fcaa40b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009c40 tx=0x7fcaa0004750 comp rx=0 tx=0).stop 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 shutdown_connections 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fca8806a0e0 0x7fca8806c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fcaa40ccd40 0x7fcaa40b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaa40b0420 0x7fcaa40b18c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 --2- 172.21.15.5:0/4047789241 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fcaa40cc960 0x7fcaa40c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 >> 172.21.15.5:0/4047789241 conn(0x7fcaa406dec0 msgr2=0x7fcaa40d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 shutdown_connections 2023-08-09T14:15:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.109+0000 7fcaac18d700 1 -- 172.21.15.5:0/4047789241 wait complete. 2023-08-09T14:15:54.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.249+0000 7f2c80c27700 1 Processor -- start 2023-08-09T14:15:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.249+0000 7f2c80c27700 1 -- start start 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c80c27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c7c0b2c70 0x7f2c7c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c80c27700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f2c7c0ce410 0x7f2c7c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c80c27700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0cb2d0 con 0x7f2c7c159e90 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c80c27700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cee00 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c80c27700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cb5b0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c7c0b2c70 0x7f2c7c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c7a59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2c7c159e90 0x7f2c7c06db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56890/0 (socket says 172.21.15.5:56890) 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c7a59c700 1 -- 172.21.15.5:0/1466180050 learned_addr learned my addr 172.21.15.5:0/1466180050 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c7ad9d700 1 --2- 172.21.15.5:0/1466180050 >> v2:172.21.15.101:3300/0 conn(0x7f2c7c0ce410 0x7f2c7c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 -- 172.21.15.5:0/1466180050 >> v2:172.21.15.101:3300/0 conn(0x7f2c7c0ce410 msgr2=0x7f2c7c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 --2- 172.21.15.5:0/1466180050 >> v2:172.21.15.101:3300/0 conn(0x7f2c7c0ce410 0x7f2c7c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 -- 172.21.15.5:0/1466180050 >> v1:172.21.15.5:6789/0 conn(0x7f2c7c159e90 legacy=0x7f2c7c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 -- 172.21.15.5:0/1466180050 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0cb890 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c7959a700 1 -- 172.21.15.5:0/1466180050 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169262494 0 0) 0x7f2c7c0cb2d0 con 0x7f2c7c159e90 2023-08-09T14:15:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.250+0000 7f2c79d9b700 1 --2- 172.21.15.5:0/1466180050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0b2c70 0x7f2c7c0cacd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0cf2e0 tx=0x7f2c6c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa366bf02d38a37 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c7959a700 1 -- 172.21.15.5:0/1466180050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c011830 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c7959a700 1 -- 172.21.15.5:0/1466180050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c011990 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c7959a700 1 -- 172.21.15.5:0/1466180050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c011d20 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 -- 172.21.15.5:0/1466180050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0b2c70 msgr2=0x7f2c7c0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 --2- 172.21.15.5:0/1466180050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0b2c70 0x7f2c7c0cacd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0cf2e0 tx=0x7f2c6c009b20 comp rx=0 tx=0).stop 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 -- 172.21.15.5:0/1466180050 shutdown_connections 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 --2- 172.21.15.5:0/1466180050 >> v2:172.21.15.101:3300/0 conn(0x7f2c7c0ce410 0x7f2c7c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 --2- 172.21.15.5:0/1466180050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0b2c70 0x7f2c7c0cacd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 -- 172.21.15.5:0/1466180050 >> 172.21.15.5:0/1466180050 conn(0x7f2c7c0b1970 msgr2=0x7f2c7c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 -- 172.21.15.5:0/1466180050 shutdown_connections 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.251+0000 7f2c80c27700 1 -- 172.21.15.5:0/1466180050 wait complete. 2023-08-09T14:15:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 Processor -- start 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 -- start start 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2c7c0b2c70 0x7f2c7c14a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 0x7f2c7c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15c1a0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c14a720 con 0x7f2c7c159e90 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c80c27700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1557b0 con 0x7f2c7c0b2c70 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c79d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c79d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43480/0 (socket says 172.21.15.5:43480) 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.253+0000 7f2c79d9b700 1 -- 172.21.15.5:0/911120983 learned_addr learned my addr 172.21.15.5:0/911120983 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 -- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2c7c0b2c70 msgr2=0x7f2c7c14a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c7a59c700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2c7c0b2c70 0x7f2c7c14a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c7ad9d700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 0x7f2c7c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2c7c0b2c70 0x7f2c7c14a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 -- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 msgr2=0x7f2c7c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 0x7f2c7c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 -- 172.21.15.5:0/911120983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0094a0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c7ad9d700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 0x7f2c7c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c79d9b700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0090b0 tx=0x7f2c6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0038a0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c003a00 con 0x7f2c7c0ce410 2023-08-09T14:15:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c155a90 con 0x7f2c7c0ce410 2023-08-09T14:15:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c003d90 con 0x7f2c7c0ce410 2023-08-09T14:15:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.254+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c15c420 con 0x7f2c7c0ce410 2023-08-09T14:15:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.255+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c155fb0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.256+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c6c01b5c0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.256+0000 7f2c6affd700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 0x7f2c5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.256+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c6c08b8e0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.256+0000 7f2c7a59c700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 0x7f2c5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.257+0000 7f2c7a59c700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 0x7f2c5c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c70000f60 tx=0x7f2c70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.260+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2c6c057060 con 0x7f2c7c0ce410 2023-08-09T14:15:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.457+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c7c074600 con 0x7f2c7c0ce410 2023-08-09T14:15:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.457+0000 7f2c6affd700 1 -- 172.21.15.5:0/911120983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c6c0150a0 con 0x7f2c7c0ce410 2023-08-09T14:15:54.459 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 msgr2=0x7f2c5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 0x7f2c5c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c70000f60 tx=0x7f2c70009040 comp rx=0 tx=0).stop 2023-08-09T14:15:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 msgr2=0x7f2c7c15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0090b0 tx=0x7f2c6c004750 comp rx=0 tx=0).stop 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 shutdown_connections 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2c5c06a0e0 0x7f2c5c06c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2c7c159e90 0x7f2c7c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2c7c0b2c70 0x7f2c7c14a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.459+0000 7f2c80c27700 1 --2- 172.21.15.5:0/911120983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c0ce410 0x7f2c7c15a5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.460+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 >> 172.21.15.5:0/911120983 conn(0x7f2c7c0b1970 msgr2=0x7f2c7c158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.460+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 shutdown_connections 2023-08-09T14:15:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.460+0000 7f2c80c27700 1 -- 172.21.15.5:0/911120983 wait complete. 2023-08-09T14:15:54.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.600+0000 7f4f2418c700 1 Processor -- start 2023-08-09T14:15:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.601+0000 7f4f2418c700 1 -- start start 2023-08-09T14:15:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.601+0000 7f4f2418c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f1c06d570 0x7f4f1c0ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.601+0000 7f4f2418c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c15e0e0 con 0x7f4f1c0cfff0 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.601+0000 7f4f2418c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c0665b0 con 0x7f4f1c071940 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.601+0000 7f4f2418c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c15ec80 con 0x7f4f1c06d570 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f1c06d570 0x7f4f1c0ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21727700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4f1c0cfff0 0x7f4f1c15e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56904/0 (socket says 172.21.15.5:56904) 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f1c06d570 0x7f4f1c0ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43488/0 (socket says 172.21.15.5:43488) 2023-08-09T14:15:54.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21727700 1 -- 172.21.15.5:0/2677951557 learned_addr learned my addr 172.21.15.5:0/2677951557 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135717722 0 0) 0x7f4f1c15e0e0 con 0x7f4f1c0cfff0 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f080035b0 con 0x7f4f1c0cfff0 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 -- 172.21.15.5:0/2677951557 >> v1:172.21.15.101:6789/0 conn(0x7f4f1c071940 legacy=0x7f4f1c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 -- 172.21.15.5:0/2677951557 >> v1:172.21.15.5:6789/0 conn(0x7f4f1c0cfff0 legacy=0x7f4f1c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256698698 0 0) 0x7f4f1c0665b0 con 0x7f4f1c071940 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 -- 172.21.15.5:0/2677951557 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c065ff0 con 0x7f4f1c06d570 2023-08-09T14:15:54.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f21f28700 1 --2- 172.21.15.5:0/2677951557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c06d570 0x7f4f1c0ceb00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68541f07b43381ed server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c005e30 con 0x7f4f1c06d570 2023-08-09T14:15:54.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c006030 con 0x7f4f1c06d570 2023-08-09T14:15:54.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.602+0000 7f4f20f26700 1 -- 172.21.15.5:0/2677951557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0063c0 con 0x7f4f1c06d570 2023-08-09T14:15:54.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 -- 172.21.15.5:0/2677951557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c06d570 msgr2=0x7f4f1c0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 --2- 172.21.15.5:0/2677951557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c06d570 0x7f4f1c0ceb00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c009b30 comp rx=0 tx=0).stop 2023-08-09T14:15:54.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 -- 172.21.15.5:0/2677951557 shutdown_connections 2023-08-09T14:15:54.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 --2- 172.21.15.5:0/2677951557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c06d570 0x7f4f1c0ceb00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 -- 172.21.15.5:0/2677951557 >> 172.21.15.5:0/2677951557 conn(0x7f4f1c0cf4d0 msgr2=0x7f4f1c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 -- 172.21.15.5:0/2677951557 shutdown_connections 2023-08-09T14:15:54.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.603+0000 7f4f2418c700 1 -- 172.21.15.5:0/2677951557 wait complete. 2023-08-09T14:15:54.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.604+0000 7f4f2418c700 1 Processor -- start 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.604+0000 7f4f2418c700 1 -- start start 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4f1c06d570 0x7f4f1c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4f1c0cfff0 0x7f4f1c0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c1ef990 con 0x7f4f1c071940 2023-08-09T14:15:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0c3a80 con 0x7f4f1c06d570 2023-08-09T14:15:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f2418c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c156a30 con 0x7f4f1c0cfff0 2023-08-09T14:15:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43494/0 (socket says 172.21.15.5:43494) 2023-08-09T14:15:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 -- 172.21.15.5:0/1047469280 learned_addr learned my addr 172.21.15.5:0/1047469280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21f28700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4f1c06d570 0x7f4f1c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f22729700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4f1c0cfff0 0x7f4f1c0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 -- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4f1c0cfff0 msgr2=0x7f4f1c0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4f1c0cfff0 0x7f4f1c0c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 -- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4f1c06d570 msgr2=0x7f4f1c1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4f1c06d570 0x7f4f1c1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.605+0000 7f4f21727700 1 -- 172.21.15.5:0/1047469280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009430 con 0x7f4f1c071940 2023-08-09T14:15:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f21727700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c500 tx=0x7f4f1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18005d70 con 0x7f4f1c071940 2023-08-09T14:15:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f180070d0 con 0x7f4f1c071940 2023-08-09T14:15:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c0c5e80 con 0x7f4f1c071940 2023-08-09T14:15:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18007440 con 0x7f4f1c071940 2023-08-09T14:15:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.606+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c1f1ed0 con 0x7f4f1c071940 2023-08-09T14:15:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.607+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c06e470 con 0x7f4f1c071940 2023-08-09T14:15:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.607+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f180075a0 con 0x7f4f1c071940 2023-08-09T14:15:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.607+0000 7f4f127fc700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 0x7f4f0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.608+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f18087900 con 0x7f4f1c071940 2023-08-09T14:15:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.608+0000 7f4f21f28700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 0x7f4f0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.608+0000 7f4f21f28700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 0x7f4f0006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c013040 tx=0x7f4f0c008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.612+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4f18053130 con 0x7f4f1c071940 2023-08-09T14:15:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.816+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f1c074600 con 0x7f4f1c071940 2023-08-09T14:15:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.816+0000 7f4f127fc700 1 -- 172.21.15.5:0/1047469280 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f18017020 con 0x7f4f1c071940 2023-08-09T14:15:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 msgr2=0x7f4f0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 0x7f4f0006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c013040 tx=0x7f4f0c008070 comp rx=0 tx=0).stop 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 msgr2=0x7f4f1c0c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c500 tx=0x7f4f1800c8c0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 shutdown_connections 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4f0006a0e0 0x7f4f0006c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4f1c0cfff0 0x7f4f1c0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4f1c06d570 0x7f4f1c1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 --2- 172.21.15.5:0/1047469280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f1c071940 0x7f4f1c0c3000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 >> 172.21.15.5:0/1047469280 conn(0x7f4f1c0cf4d0 msgr2=0x7f4f1c0aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 shutdown_connections 2023-08-09T14:15:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.818+0000 7f4f2418c700 1 -- 172.21.15.5:0/1047469280 wait complete. 2023-08-09T14:15:54.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.958+0000 7f40d2f23700 1 Processor -- start 2023-08-09T14:15:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.958+0000 7f40d2f23700 1 -- start start 2023-08-09T14:15:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.959+0000 7f40d2f23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 0x7f40cc0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.959+0000 7f40d2f23700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 0x7f40cc0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.959+0000 7f40d2f23700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0715a0 con 0x7f40cc06a1c0 2023-08-09T14:15:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.959+0000 7f40d2f23700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0cd6c0 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.959+0000 7f40d2f23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0712a0 con 0x7f40cc15d3a0 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 0x7f40cc0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40cbfff700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 0x7f40cc0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d14c0700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f40cc06a1c0 0x7f40cc160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38262/0 (socket says 172.21.15.5:38262) 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40cbfff700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 0x7f40cc0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60548/0 (socket says 172.21.15.5:60548) 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d14c0700 1 -- 172.21.15.5:0/2188313512 learned_addr learned my addr 172.21.15.5:0/2188313512 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 -- 172.21.15.5:0/2188313512 >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 msgr2=0x7f40cc0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 --2- 172.21.15.5:0/2188313512 >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 0x7f40cc0cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 -- 172.21.15.5:0/2188313512 >> v1:172.21.15.101:6789/0 conn(0x7f40cc06a1c0 legacy=0x7f40cc160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 -- 172.21.15.5:0/2188313512 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0cf570 con 0x7f40cc15d3a0 2023-08-09T14:15:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40d0cbf700 1 --2- 172.21.15.5:0/2188313512 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 0x7f40cc0af2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009840 tx=0x7f40c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541c4a1d4a1be1e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40cb7fe700 1 -- 172.21.15.5:0/2188313512 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011830 con 0x7f40cc15d3a0 2023-08-09T14:15:54.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40cb7fe700 1 -- 172.21.15.5:0/2188313512 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0011990 con 0x7f40cc15d3a0 2023-08-09T14:15:54.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.960+0000 7f40cb7fe700 1 -- 172.21.15.5:0/2188313512 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011d20 con 0x7f40cc15d3a0 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 -- 172.21.15.5:0/2188313512 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 msgr2=0x7f40cc0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 --2- 172.21.15.5:0/2188313512 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 0x7f40cc0af2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009840 tx=0x7f40c0009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 -- 172.21.15.5:0/2188313512 shutdown_connections 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 --2- 172.21.15.5:0/2188313512 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc15d3a0 0x7f40cc0af2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 --2- 172.21.15.5:0/2188313512 >> v2:172.21.15.101:3300/0 conn(0x7f40cc0cd1c0 0x7f40cc0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 -- 172.21.15.5:0/2188313512 >> 172.21.15.5:0/2188313512 conn(0x7f40cc0b1970 msgr2=0x7f40cc0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 -- 172.21.15.5:0/2188313512 shutdown_connections 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.961+0000 7f40d2f23700 1 -- 172.21.15.5:0/2188313512 wait complete. 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.962+0000 7f40d2f23700 1 Processor -- start 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.962+0000 7f40d2f23700 1 -- start start 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc06a1c0 0x7f40cc15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f40cc15d3a0 0x7f40cc0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b3930 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b3bd0 con 0x7f40cc15d3a0 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d2f23700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b3eb0 con 0x7f40cc06a1c0 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43508/0 (socket says 172.21.15.5:43508) 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40cbfff700 1 -- 172.21.15.5:0/1546253089 learned_addr learned my addr 172.21.15.5:0/1546253089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d14c0700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f40cc15d3a0 0x7f40cc0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.963+0000 7f40d0cbf700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc06a1c0 0x7f40cc15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 -- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc06a1c0 msgr2=0x7f40cc15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc06a1c0 0x7f40cc15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 -- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f40cc15d3a0 msgr2=0x7f40cc0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f40cc15d3a0 0x7f40cc0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 -- 172.21.15.5:0/1546253089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00094a0 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40cbfff700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e9b0 tx=0x7f40b800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8009710 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800ee50 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc0b4190 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800ca50 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.964+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc0b4750 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.965+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc0b4940 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.965+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40b800cbb0 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.966+0000 7f40c97fa700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 0x7f40b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.966+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40b8088580 con 0x7f40cc0cd1c0 2023-08-09T14:15:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.966+0000 7f40d0cbf700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 0x7f40b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.967+0000 7f40d0cbf700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 0x7f40b006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:54.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:54.971+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f40b8057680 con 0x7f40cc0cd1c0 2023-08-09T14:15:55.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.168+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40cc074600 con 0x7f40cc0cd1c0 2023-08-09T14:15:55.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.168+0000 7f40c97fa700 1 -- 172.21.15.5:0/1546253089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40b800ce60 con 0x7f40cc0cd1c0 2023-08-09T14:15:55.170 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.170+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 msgr2=0x7f40b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.170+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 0x7f40b006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0008030 comp rx=0 tx=0).stop 2023-08-09T14:15:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 msgr2=0x7f40cc0b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e9b0 tx=0x7f40b800ecc0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 shutdown_connections 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f40b006a0e0 0x7f40b006c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f40cc15d3a0 0x7f40cc0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f40cc06a1c0 0x7f40cc15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 --2- 172.21.15.5:0/1546253089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc0cd1c0 0x7f40cc0b33f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 >> 172.21.15.5:0/1546253089 conn(0x7f40cc0b1970 msgr2=0x7f40cc15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 shutdown_connections 2023-08-09T14:15:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.171+0000 7f40d2f23700 1 -- 172.21.15.5:0/1546253089 wait complete. 2023-08-09T14:15:55.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.307+0000 7f6081874700 1 Processor -- start 2023-08-09T14:15:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.307+0000 7f6081874700 1 -- start start 2023-08-09T14:15:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f6081874700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f607c15db90 0x7f607c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f6081874700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c06b3d0 0x7f607c15df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f6081874700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c0aec20 con 0x7f607c15e4b0 2023-08-09T14:15:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f6081874700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0cb660 con 0x7f607c15db90 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f6081874700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0cb0c0 con 0x7f607c06b3d0 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f607affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f607c15db90 0x7f607c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f607b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f607c15e4b0 0x7f607c071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56934/0 (socket says 172.21.15.5:56934) 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.308+0000 7f607b7fe700 1 -- 172.21.15.5:0/4156967788 learned_addr learned my addr 172.21.15.5:0/4156967788 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607a7fc700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c06b3d0 0x7f607c15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607affd700 1 -- 172.21.15.5:0/4156967788 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c06b3d0 msgr2=0x7f607c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607affd700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c06b3d0 0x7f607c15df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607affd700 1 -- 172.21.15.5:0/4156967788 >> v1:172.21.15.5:6789/0 conn(0x7f607c15e4b0 legacy=0x7f607c071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607affd700 1 -- 172.21.15.5:0/4156967788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0cb380 con 0x7f607c15db90 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f6079ffb700 1 -- 172.21.15.5:0/4156967788 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282697087 0 0) 0x7f607c0aec20 con 0x7f607c15e4b0 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f607affd700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c15db90 0x7f607c0cefd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6070009840 tx=0x7f6070009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8367bf8c1335d30 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f6079ffb700 1 -- 172.21.15.5:0/4156967788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070011830 con 0x7f607c15db90 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f6079ffb700 1 -- 172.21.15.5:0/4156967788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070011990 con 0x7f607c15db90 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.309+0000 7f6079ffb700 1 -- 172.21.15.5:0/4156967788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070011d20 con 0x7f607c15db90 2023-08-09T14:15:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 -- 172.21.15.5:0/4156967788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c15db90 msgr2=0x7f607c0cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c15db90 0x7f607c0cefd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6070009840 tx=0x7f6070009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 -- 172.21.15.5:0/4156967788 shutdown_connections 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c15db90 0x7f607c0cefd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 --2- 172.21.15.5:0/4156967788 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c06b3d0 0x7f607c15df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 -- 172.21.15.5:0/4156967788 >> 172.21.15.5:0/4156967788 conn(0x7f607c0cf560 msgr2=0x7f607c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 -- 172.21.15.5:0/4156967788 shutdown_connections 2023-08-09T14:15:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.310+0000 7f6081874700 1 -- 172.21.15.5:0/4156967788 wait complete. 2023-08-09T14:15:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.311+0000 7f6081874700 1 Processor -- start 2023-08-09T14:15:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.311+0000 7f6081874700 1 -- start start 2023-08-09T14:15:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c15db90 0x7f607c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f607c15e4b0 0x7f607c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0acd70 con 0x7f607c06b3d0 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0ad050 con 0x7f607c15e4b0 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f6081874700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0ad330 con 0x7f607c15db90 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43520/0 (socket says 172.21.15.5:43520) 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 -- 172.21.15.5:0/3734153474 learned_addr learned my addr 172.21.15.5:0/3734153474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607b7fe700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f607c15e4b0 0x7f607c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 -- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c15db90 msgr2=0x7f607c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607a7fc700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c15db90 0x7f607c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c15db90 0x7f607c153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 -- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f607c15e4b0 msgr2=0x7f607c14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f607c15e4b0 0x7f607c14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 -- 172.21.15.5:0/3734153474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700094a0 con 0x7f607c06b3d0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.312+0000 7f607affd700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60700090b0 tx=0x7f6070004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.313+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700038a0 con 0x7f607c06b3d0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.313+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607001f070 con 0x7f607c06b3d0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.313+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c0ad610 con 0x7f607c06b3d0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.313+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070003c00 con 0x7f607c06b3d0 2023-08-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.313+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c14feb0 con 0x7f607c06b3d0 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.314+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c074600 con 0x7f607c06b3d0 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.314+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f607001a430 con 0x7f607c06b3d0 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.314+0000 7f6063fff700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 0x7f606806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.314+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6070021070 con 0x7f607c06b3d0 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.315+0000 7f607a7fc700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 0x7f606806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.315+0000 7f607a7fc700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 0x7f606806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f607c153970 tx=0x7f606c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.319+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f607008d030 con 0x7f607c06b3d0 2023-08-09T14:15:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.518+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f607c0cedb0 con 0x7f607c06b3d0 2023-08-09T14:15:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.519+0000 7f6063fff700 1 -- 172.21.15.5:0/3734153474 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f6070055610 con 0x7f607c06b3d0 2023-08-09T14:15:55.521 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:55.521 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 msgr2=0x7f606806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 0x7f606806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f607c153970 tx=0x7f606c008040 comp rx=0 tx=0).stop 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 msgr2=0x7f607c0ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60700090b0 tx=0x7f6070004750 comp rx=0 tx=0).stop 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 shutdown_connections 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f606806a0e0 0x7f606806c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f607c15e4b0 0x7f607c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06b3d0 0x7f607c0ade10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 --2- 172.21.15.5:0/3734153474 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f607c15db90 0x7f607c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 >> 172.21.15.5:0/3734153474 conn(0x7f607c0cf560 msgr2=0x7f607c0718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 shutdown_connections 2023-08-09T14:15:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.521+0000 7f6081874700 1 -- 172.21.15.5:0/3734153474 wait complete. 2023-08-09T14:15:55.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:55.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.664+0000 7f9221aca700 1 Processor -- start 2023-08-09T14:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.664+0000 7f9221aca700 1 -- start start 2023-08-09T14:15:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f9221aca700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f921c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f9221aca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c06bce0 con 0x7f921c0cc960 2023-08-09T14:15:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f9221aca700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c06ccf0 con 0x7f921c0ccd40 2023-08-09T14:15:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f9221aca700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c06cb50 con 0x7f921c0b0420 2023-08-09T14:15:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f921c0cc960 0x7f921c160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56944/0 (socket says 172.21.15.5:56944) 2023-08-09T14:15:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921b7fe700 1 -- 172.21.15.5:0/1167997350 learned_addr learned my addr 172.21.15.5:0/1167997350 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921bfff700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f921c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273762522 0 0) 0x7f921c06bce0 con 0x7f921c0cc960 2023-08-09T14:15:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92040035b0 con 0x7f921c0cc960 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202864223 0 0) 0x7f92040035b0 con 0x7f921c0cc960 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 msgr2=0x7f921c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f921c06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 >> v1:172.21.15.101:6789/0 conn(0x7f921c0ccd40 legacy=0x7f921c0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c06c210 con 0x7f921c0cc960 2023-08-09T14:15:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f920c001670 con 0x7f921c0cc960 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 >> v1:172.21.15.5:6789/0 conn(0x7f921c0cc960 legacy=0x7f921c160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f9204003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9204003fb0 0x7f9204004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9204004d90 0x7f9204005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.665+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bba0 con 0x7f9204004d90 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bce0 con 0x7f9204003fb0 2023-08-09T14:15:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bea0 con 0x7f921c0b0420 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9204004d90 0x7f9204005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921affd700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9204003fb0 0x7f9204004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921b7fe700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f9204003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 -- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 msgr2=0x7f9204003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c0b0420 0x7f9204003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 -- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9204003fb0 msgr2=0x7f9204004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:55.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9204003fb0 0x7f9204004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 -- 172.21.15.5:0/1167997350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040035b0 con 0x7f9204004d90 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921bfff700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9204004d90 0x7f9204005210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9214009fc0 tx=0x7f9204005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0c80942b6a3c69 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400ec30 con 0x7f9204004d90 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400f040 con 0x7f9204004d90 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.666+0000 7f921a7fc700 1 -- 172.21.15.5:0/1167997350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214014480 con 0x7f9204004d90 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 -- 172.21.15.5:0/1167997350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9204004d90 msgr2=0x7f9204005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 --2- 172.21.15.5:0/1167997350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9204004d90 0x7f9204005210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9214009fc0 tx=0x7f9204005880 comp rx=0 tx=0).stop 2023-08-09T14:15:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f921bfff700 1 -- 172.21.15.5:0/1167997350 reap_dead start 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 -- 172.21.15.5:0/1167997350 shutdown_connections 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 -- 172.21.15.5:0/1167997350 >> 172.21.15.5:0/1167997350 conn(0x7f921c06dec0 msgr2=0x7f921c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 -- 172.21.15.5:0/1167997350 shutdown_connections 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.667+0000 7f9221aca700 1 -- 172.21.15.5:0/1167997350 wait complete. 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.668+0000 7f9221aca700 1 Processor -- start 2023-08-09T14:15:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.668+0000 7f9221aca700 1 -- start start 2023-08-09T14:15:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f921c156300 0x7f921c153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c1e86f0 0x7f921c1e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1e90b0 con 0x7f921c1e7bc0 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b4990 con 0x7f921c156300 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f9221aca700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b4c70 con 0x7f921c1e86f0 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43538/0 (socket says 172.21.15.5:43538) 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 -- 172.21.15.5:0/888288940 learned_addr learned my addr 172.21.15.5:0/888288940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921affd700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f921c156300 0x7f921c153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921bfff700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c1e86f0 0x7f921c1e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 -- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c1e86f0 msgr2=0x7f921c1e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c1e86f0 0x7f921c1e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 -- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f921c156300 msgr2=0x7f921c153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f921c156300 0x7f921c153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.669+0000 7f921b7fe700 1 -- 172.21.15.5:0/888288940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0b4f50 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f921b7fe700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f920c0011e0 tx=0x7f920c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00f8d0 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c00fa50 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00fe00 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c0b5230 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.670+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c1e7fa0 con 0x7f921c1e7bc0 2023-08-09T14:15:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.671+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c161530 con 0x7f921c1e7bc0 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.671+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f920c01d460 con 0x7f921c1e7bc0 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.671+0000 7f9203fff700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 0x7f920806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.672+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f920c088710 con 0x7f921c1e7bc0 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.672+0000 7f921affd700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 0x7f920806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.672+0000 7f921affd700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 0x7f920806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f921c156800 tx=0x7f9210009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.676+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f921c161530 con 0x7f921c1e7bc0 2023-08-09T14:15:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.874+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f921c161530 con 0x7f921c1e7bc0 2023-08-09T14:15:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.874+0000 7f9203fff700 1 -- 172.21.15.5:0/888288940 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f921c161530 con 0x7f921c1e7bc0 2023-08-09T14:15:55.876 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 msgr2=0x7f920806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 0x7f920806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f921c156800 tx=0x7f9210009040 comp rx=0 tx=0).stop 2023-08-09T14:15:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 msgr2=0x7f921c0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f920c0011e0 tx=0x7f920c007620 comp rx=0 tx=0).stop 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 shutdown_connections 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f920806a0e0 0x7f920806c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f921c1e86f0 0x7f921c1e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921c1e7bc0 0x7f921c0b4040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 --2- 172.21.15.5:0/888288940 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f921c156300 0x7f921c153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.876+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 >> 172.21.15.5:0/888288940 conn(0x7f921c06dec0 msgr2=0x7f921c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.877+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 shutdown_connections 2023-08-09T14:15:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:55.877+0000 7f9221aca700 1 -- 172.21.15.5:0/888288940 wait complete. 2023-08-09T14:15:55.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.018+0000 7f3fe9435700 1 Processor -- start 2023-08-09T14:15:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.018+0000 7f3fe9435700 1 -- start start 2023-08-09T14:15:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe9435700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe40cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe9435700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fe40b2c70 0x7f3fe406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe9435700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40cb2d0 con 0x7f3fe40ce410 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe9435700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40cb5b0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe9435700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40cb890 con 0x7f3fe4159e90 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe27fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fe40b2c70 0x7f3fe406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe27fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fe40b2c70 0x7f3fe406db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43548/0 (socket says 172.21.15.5:43548) 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe27fc700 1 -- 172.21.15.5:0/866859861 learned_addr learned my addr 172.21.15.5:0/866859861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.019+0000 7f3fe2ffd700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe40cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe27fc700 1 -- 172.21.15.5:0/866859861 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 msgr2=0x7f3fe40cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe40cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe27fc700 1 -- 172.21.15.5:0/866859861 >> v1:172.21.15.101:6789/0 conn(0x7f3fe40ce410 legacy=0x7f3fe4070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe27fc700 1 -- 172.21.15.5:0/866859861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40cbb70 con 0x7f3fe40b2c70 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406db30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400bb90 tx=0x7f3fd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fe1a37b6e20cb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe1ffb700 1 -- 172.21.15.5:0/866859861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400dd30 con 0x7f3fe40b2c70 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe1ffb700 1 -- 172.21.15.5:0/866859861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400de90 con 0x7f3fe40b2c70 2023-08-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe1ffb700 1 -- 172.21.15.5:0/866859861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4010690 con 0x7f3fe40b2c70 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe9435700 1 -- 172.21.15.5:0/866859861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 msgr2=0x7f3fe406db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.020+0000 7f3fe9435700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406db30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400bb90 tx=0x7f3fd400bea0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 -- 172.21.15.5:0/866859861 shutdown_connections 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe40cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 --2- 172.21.15.5:0/866859861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406db30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 -- 172.21.15.5:0/866859861 >> 172.21.15.5:0/866859861 conn(0x7f3fe40b1970 msgr2=0x7f3fe40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 -- 172.21.15.5:0/866859861 shutdown_connections 2023-08-09T14:15:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.021+0000 7f3fe9435700 1 -- 172.21.15.5:0/866859861 wait complete. 2023-08-09T14:15:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.022+0000 7f3fe9435700 1 Processor -- start 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.022+0000 7f3fe9435700 1 -- start start 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 0x7f3fe415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe4153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c79b0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c7c90 con 0x7f3fe40ce410 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c7f70 con 0x7f3fe4159e90 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43552/0 (socket says 172.21.15.5:43552) 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 -- 172.21.15.5:0/2235089468 learned_addr learned my addr 172.21.15.5:0/2235089468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 0x7f3fe415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe37fe700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe4153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 -- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 msgr2=0x7f3fe4153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe4153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 -- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 msgr2=0x7f3fe415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 0x7f3fe415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 -- 172.21.15.5:0/2235089468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd400b7f0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 0x7f3fe415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe2ffd700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e870 tx=0x7f3fd800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8009590 con 0x7f3fe40b2c70 2023-08-09T14:15:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800ee70 con 0x7f3fe40b2c70 2023-08-09T14:15:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40c8250 con 0x7f3fe40b2c70 2023-08-09T14:15:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.023+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800ca50 con 0x7f3fe40b2c70 2023-08-09T14:15:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.024+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41547c0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.024+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4074600 con 0x7f3fe40b2c70 2023-08-09T14:15:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.025+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3fd800cbb0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.025+0000 7f3fcb7fe700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 0x7f3fd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.025+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fd8088500 con 0x7f3fe40b2c70 2023-08-09T14:15:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.026+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 0x7f3fd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.026+0000 7f3fe27fc700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 0x7f3fd006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40b3050 tx=0x7f3fd4013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.030+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3fd8057710 con 0x7f3fe40b2c70 2023-08-09T14:15:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.228+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fe40ce1f0 con 0x7f3fe40b2c70 2023-08-09T14:15:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.228+0000 7f3fcb7fe700 1 -- 172.21.15.5:0/2235089468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fd800ce60 con 0x7f3fe40b2c70 2023-08-09T14:15:56.229 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 msgr2=0x7f3fd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 0x7f3fd006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40b3050 tx=0x7f3fd4013000 comp rx=0 tx=0).stop 2023-08-09T14:15:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 msgr2=0x7f3fe406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e870 tx=0x7f3fd800ec30 comp rx=0 tx=0).stop 2023-08-09T14:15:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 shutdown_connections 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3fd006a0e0 0x7f3fd006c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3fe4159e90 0x7f3fe4153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe40b2c70 0x7f3fe406a9d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 --2- 172.21.15.5:0/2235089468 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3fe40ce410 0x7f3fe415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 >> 172.21.15.5:0/2235089468 conn(0x7f3fe40b1970 msgr2=0x7f3fe40b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 shutdown_connections 2023-08-09T14:15:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.230+0000 7f3fe9435700 1 -- 172.21.15.5:0/2235089468 wait complete. 2023-08-09T14:15:56.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.369+0000 7fa4adc74700 1 Processor -- start 2023-08-09T14:15:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.369+0000 7fa4adc74700 1 -- start start 2023-08-09T14:15:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4adc74700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fa4a806d570 0x7fa4a80ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4adc74700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a815e0e0 con 0x7fa4a80cfff0 2023-08-09T14:15:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4adc74700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80665b0 con 0x7fa4a8071940 2023-08-09T14:15:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4adc74700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a815ec80 con 0x7fa4a806d570 2023-08-09T14:15:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4a6ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa4a80cfff0 0x7fa4a815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56978/0 (socket says 172.21.15.5:56978) 2023-08-09T14:15:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4a6ffd700 1 -- 172.21.15.5:0/237026419 learned_addr learned my addr 172.21.15.5:0/237026419 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4a77fe700 1 --2- 172.21.15.5:0/237026419 >> v2:172.21.15.101:3300/0 conn(0x7fa4a806d570 0x7fa4a80ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.370+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400970962 0 0) 0x7fa4a815e0e0 con 0x7fa4a80cfff0 2023-08-09T14:15:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4940035b0 con 0x7fa4a80cfff0 2023-08-09T14:15:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294471339 0 0) 0x7fa4a80665b0 con 0x7fa4a8071940 2023-08-09T14:15:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a815e0e0 con 0x7fa4a8071940 2023-08-09T14:15:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432359513 0 0) 0x7fa4940035b0 con 0x7fa4a80cfff0 2023-08-09T14:15:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a77fe700 1 -- 172.21.15.5:0/237026419 >> v1:172.21.15.101:6789/0 conn(0x7fa4a8071940 legacy=0x7fa4a80b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a77fe700 1 -- 172.21.15.5:0/237026419 >> v1:172.21.15.5:6789/0 conn(0x7fa4a80cfff0 legacy=0x7fa4a815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a77fe700 1 -- 172.21.15.5:0/237026419 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8065ff0 con 0x7fa4a806d570 2023-08-09T14:15:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a77fe700 1 --2- 172.21.15.5:0/237026419 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a806d570 0x7fa4a80ceb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa498009820 tx=0x7fa498009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4dd3cf95e766f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490001670 con 0x7fa4a806d570 2023-08-09T14:15:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498005c30 con 0x7fa4a806d570 2023-08-09T14:15:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.371+0000 7fa4a67fc700 1 -- 172.21.15.5:0/237026419 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498004030 con 0x7fa4a806d570 2023-08-09T14:15:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 -- 172.21.15.5:0/237026419 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a806d570 msgr2=0x7fa4a80ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 --2- 172.21.15.5:0/237026419 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a806d570 0x7fa4a80ceb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa498009820 tx=0x7fa498009b30 comp rx=0 tx=0).stop 2023-08-09T14:15:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 -- 172.21.15.5:0/237026419 shutdown_connections 2023-08-09T14:15:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 --2- 172.21.15.5:0/237026419 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a806d570 0x7fa4a80ceb00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 -- 172.21.15.5:0/237026419 >> 172.21.15.5:0/237026419 conn(0x7fa4a80cf4d0 msgr2=0x7fa4a80cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 -- 172.21.15.5:0/237026419 shutdown_connections 2023-08-09T14:15:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.372+0000 7fa4adc74700 1 -- 172.21.15.5:0/237026419 wait complete. 2023-08-09T14:15:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.373+0000 7fa4adc74700 1 Processor -- start 2023-08-09T14:15:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.373+0000 7fa4adc74700 1 -- start start 2023-08-09T14:15:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 0x7fa4a80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 0x7fa4a8098910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a809bde0 con 0x7fa4a806d570 2023-08-09T14:15:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a815a7a0 con 0x7fa4a8071940 2023-08-09T14:15:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4adc74700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c6ae0 con 0x7fa4a80cfff0 2023-08-09T14:15:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43566/0 (socket says 172.21.15.5:43566) 2023-08-09T14:15:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 -- 172.21.15.5:0/4121457784 learned_addr learned my addr 172.21.15.5:0/4121457784 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a7fff700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 0x7fa4a8098910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a6ffd700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 0x7fa4a80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 -- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 msgr2=0x7fa4a8098910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 0x7fa4a8098910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 -- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 msgr2=0x7fa4a80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 0x7fa4a80c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 -- 172.21.15.5:0/4121457784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009430 con 0x7fa4a806d570 2023-08-09T14:15:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a7fff700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 0x7fa4a8098910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a6ffd700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 0x7fa4a80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.374+0000 7fa4a77fe700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.375+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498003d20 con 0x7fa4a806d570 2023-08-09T14:15:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.375+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498011420 con 0x7fa4a806d570 2023-08-09T14:15:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.375+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a809d2f0 con 0x7fa4a806d570 2023-08-09T14:15:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.375+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498003ea0 con 0x7fa4a806d570 2023-08-09T14:15:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.375+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a809b720 con 0x7fa4a806d570 2023-08-09T14:15:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.376+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a806e470 con 0x7fa4a806d570 2023-08-09T14:15:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.376+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa498018030 con 0x7fa4a806d570 2023-08-09T14:15:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.376+0000 7fa49ffff700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 0x7fa48806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.377+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa498089680 con 0x7fa4a806d570 2023-08-09T14:15:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.377+0000 7fa4a6ffd700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 0x7fa48806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.377+0000 7fa4a6ffd700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 0x7fa48806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa4a806bb00 tx=0x7fa490009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.381+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa498054e00 con 0x7fa4a806d570 2023-08-09T14:15:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.579+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4a815dd70 con 0x7fa4a806d570 2023-08-09T14:15:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.579+0000 7fa49ffff700 1 -- 172.21.15.5:0/4121457784 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa498058420 con 0x7fa4a806d570 2023-08-09T14:15:56.581 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 msgr2=0x7fa48806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 0x7fa48806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa4a806bb00 tx=0x7fa490009040 comp rx=0 tx=0).stop 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 msgr2=0x7fa4a809c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498004750 comp rx=0 tx=0).stop 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 shutdown_connections 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa48806a0e0 0x7fa48806c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa4a80cfff0 0x7fa4a8098910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4a806d570 0x7fa4a809c200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 --2- 172.21.15.5:0/4121457784 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa4a8071940 0x7fa4a80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 >> 172.21.15.5:0/4121457784 conn(0x7fa4a80cf4d0 msgr2=0x7fa4a815d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 shutdown_connections 2023-08-09T14:15:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.582+0000 7fa4adc74700 1 -- 172.21.15.5:0/4121457784 wait complete. 2023-08-09T14:15:56.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.721+0000 7fed2a7fa700 1 Processor -- start 2023-08-09T14:15:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.721+0000 7fed2a7fa700 1 -- start start 2023-08-09T14:15:56.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed2a7fa700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 0x7fed240af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed2a7fa700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240715a0 con 0x7fed2415d3a0 2023-08-09T14:15:56.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed2a7fa700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240712a0 con 0x7fed2406a1c0 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed2a7fa700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240cd6c0 con 0x7fed240cd1c0 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed23fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed2415d3a0 0x7fed240cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56990/0 (socket says 172.21.15.5:56990) 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed23fff700 1 -- 172.21.15.5:0/77527699 learned_addr learned my addr 172.21.15.5:0/77527699 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed237fe700 1 --2- 172.21.15.5:0/77527699 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 0x7fed240af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791906402 0 0) 0x7fed240715a0 con 0x7fed2415d3a0 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.722+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed100035b0 con 0x7fed2415d3a0 2023-08-09T14:15:56.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886099158 0 0) 0x7fed240712a0 con 0x7fed2406a1c0 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed240715a0 con 0x7fed2406a1c0 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226781600 0 0) 0x7fed100035b0 con 0x7fed2415d3a0 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed237fe700 1 -- 172.21.15.5:0/77527699 >> v1:172.21.15.101:6789/0 conn(0x7fed2406a1c0 legacy=0x7fed24160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed237fe700 1 -- 172.21.15.5:0/77527699 >> v1:172.21.15.5:6789/0 conn(0x7fed2415d3a0 legacy=0x7fed240cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed237fe700 1 -- 172.21.15.5:0/77527699 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240ce110 con 0x7fed240cd1c0 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed237fe700 1 --2- 172.21.15.5:0/77527699 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 0x7fed240af2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009870 tx=0x7fed0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=471459d475db046f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14001670 con 0x7fed240cd1c0 2023-08-09T14:15:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c004030 con 0x7fed240cd1c0 2023-08-09T14:15:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.723+0000 7fed22ffd700 1 -- 172.21.15.5:0/77527699 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0043c0 con 0x7fed240cd1c0 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 -- 172.21.15.5:0/77527699 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 msgr2=0x7fed240af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/77527699 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 0x7fed240af2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009870 tx=0x7fed0c009b80 comp rx=0 tx=0).stop 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 -- 172.21.15.5:0/77527699 shutdown_connections 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/77527699 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed240cd1c0 0x7fed240af2c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 -- 172.21.15.5:0/77527699 >> 172.21.15.5:0/77527699 conn(0x7fed240b1970 msgr2=0x7fed240b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 -- 172.21.15.5:0/77527699 shutdown_connections 2023-08-09T14:15:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.724+0000 7fed2a7fa700 1 -- 172.21.15.5:0/77527699 wait complete. 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.725+0000 7fed2a7fa700 1 Processor -- start 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.725+0000 7fed2a7fa700 1 -- start start 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed2406a1c0 0x7fed241f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fed240cd1c0 0x7fed240c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2414d660 con 0x7fed2415d3a0 2023-08-09T14:15:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed241603e0 con 0x7fed240cd1c0 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed2a7fa700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed24160100 con 0x7fed2406a1c0 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43584/0 (socket says 172.21.15.5:43584) 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 -- 172.21.15.5:0/2629050543 learned_addr learned my addr 172.21.15.5:0/2629050543 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed23fff700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed2406a1c0 0x7fed241f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed237fe700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fed240cd1c0 0x7fed240c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 -- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed2406a1c0 msgr2=0x7fed241f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed2406a1c0 0x7fed241f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 -- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fed240cd1c0 msgr2=0x7fed240c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fed240cd1c0 0x7fed240c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.726+0000 7fed28d97700 1 -- 172.21.15.5:0/2629050543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0094a0 con 0x7fed2415d3a0 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed28d97700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00cc20 tx=0x7fed1c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003c00 con 0x7fed2415d3a0 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c003d60 con 0x7fed2415d3a0 2023-08-09T14:15:56.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00aae0 con 0x7fed2415d3a0 2023-08-09T14:15:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2414cfa0 con 0x7fed2415d3a0 2023-08-09T14:15:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.727+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2415f3f0 con 0x7fed2415d3a0 2023-08-09T14:15:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.728+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24074600 con 0x7fed2415d3a0 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.728+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed1c00ac40 con 0x7fed2415d3a0 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.729+0000 7fed20ff9700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 0x7fed0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.729+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed1c088510 con 0x7fed2415d3a0 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.729+0000 7fed23fff700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 0x7fed0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.729+0000 7fed23fff700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 0x7fed0406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed240b2f70 tx=0x7fed14000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.733+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fed1c053c90 con 0x7fed2415d3a0 2023-08-09T14:15:56.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.931+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed240b27c0 con 0x7fed2415d3a0 2023-08-09T14:15:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.931+0000 7fed20ff9700 1 -- 172.21.15.5:0/2629050543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed1c0572b0 con 0x7fed2415d3a0 2023-08-09T14:15:56.933 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 msgr2=0x7fed0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 0x7fed0406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed240b2f70 tx=0x7fed14000bc0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 msgr2=0x7fed240c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00cc20 tx=0x7fed1c00cf30 comp rx=0 tx=0).stop 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 shutdown_connections 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fed0406a0e0 0x7fed0406c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2415d3a0 0x7fed240c3e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fed2406a1c0 0x7fed241f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 --2- 172.21.15.5:0/2629050543 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fed240cd1c0 0x7fed240c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 >> 172.21.15.5:0/2629050543 conn(0x7fed240b1970 msgr2=0x7fed240b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 shutdown_connections 2023-08-09T14:15:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:56.933+0000 7fed2a7fa700 1 -- 172.21.15.5:0/2629050543 wait complete. 2023-08-09T14:15:56.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:15:57.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.070+0000 7f0351863700 1 Processor -- start 2023-08-09T14:15:57.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.070+0000 7f0351863700 1 -- start start 2023-08-09T14:15:57.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f0351863700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f034c0cb590 0x7f034c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f0351863700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 0x7f034c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f0351863700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c0cd880 con 0x7f034c15b1e0 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f0351863700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0b3420 con 0x7f034c0cb590 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f0351863700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0d1e50 con 0x7f034c0b2f90 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f034a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f034c0cb590 0x7f034c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f034affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f034c15b1e0 0x7f034c0cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57004/0 (socket says 172.21.15.5:57004) 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f034a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f034c0cb590 0x7f034c0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43590/0 (socket says 172.21.15.5:43590) 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.071+0000 7f034affd700 1 -- 172.21.15.5:0/825755629 learned_addr learned my addr 172.21.15.5:0/825755629 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034b7fe700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 0x7f034c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034a7fc700 1 -- 172.21.15.5:0/825755629 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 msgr2=0x7f034c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034a7fc700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 0x7f034c15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034a7fc700 1 -- 172.21.15.5:0/825755629 >> v1:172.21.15.5:6789/0 conn(0x7f034c15b1e0 legacy=0x7f034c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034a7fc700 1 -- 172.21.15.5:0/825755629 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c06f7e0 con 0x7f034c0cb590 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f0349ffb700 1 -- 172.21.15.5:0/825755629 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509602811 0 0) 0x7f034c0cd880 con 0x7f034c15b1e0 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034b7fe700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 0x7f034c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f034a7fc700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0cb590 0x7f034c0b2a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f033c009840 tx=0x7f033c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333b386b9cfe096c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f0349ffb700 1 -- 172.21.15.5:0/825755629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011830 con 0x7f034c0cb590 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f0349ffb700 1 -- 172.21.15.5:0/825755629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c011990 con 0x7f034c0cb590 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.072+0000 7f0349ffb700 1 -- 172.21.15.5:0/825755629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011d20 con 0x7f034c0cb590 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 -- 172.21.15.5:0/825755629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0cb590 msgr2=0x7f034c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0cb590 0x7f034c0b2a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f033c009840 tx=0x7f033c009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 -- 172.21.15.5:0/825755629 shutdown_connections 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c0b2f90 0x7f034c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 --2- 172.21.15.5:0/825755629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0cb590 0x7f034c0b2a50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 -- 172.21.15.5:0/825755629 >> 172.21.15.5:0/825755629 conn(0x7f034c0d0fd0 msgr2=0x7f034c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 -- 172.21.15.5:0/825755629 shutdown_connections 2023-08-09T14:15:57.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.073+0000 7f0351863700 1 -- 172.21.15.5:0/825755629 wait complete. 2023-08-09T14:15:57.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.074+0000 7f0351863700 1 Processor -- start 2023-08-09T14:15:57.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.074+0000 7f0351863700 1 -- start start 2023-08-09T14:15:57.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 0x7f034c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 0x7f034c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c149a60 con 0x7f034c0b2f90 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1495d0 con 0x7f034c0cb590 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f0351863700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1489c0 con 0x7f034c15b1e0 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43594/0 (socket says 172.21.15.5:43594) 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 -- 172.21.15.5:0/1274953922 learned_addr learned my addr 172.21.15.5:0/1274953922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 -- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 msgr2=0x7f034c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034b7fe700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 0x7f034c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034a7fc700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 0x7f034c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 0x7f034c15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 -- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 msgr2=0x7f034c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 0x7f034c15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 -- 172.21.15.5:0/1274953922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0094a0 con 0x7f034c0b2f90 2023-08-09T14:15:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034a7fc700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 0x7f034c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034b7fe700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 0x7f034c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.075+0000 7f034affd700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f034000c550 tx=0x7f034000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.076+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340004c80 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.076+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340004e00 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.076+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c148ca0 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.076+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340007310 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.076+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c149260 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.077+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c1498b0 con 0x7f034c0b2f90 2023-08-09T14:15:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.077+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0340007470 con 0x7f034c0b2f90 2023-08-09T14:15:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.078+0000 7f0333fff700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 0x7f033806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.078+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0340088250 con 0x7f034c0b2f90 2023-08-09T14:15:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.078+0000 7f034a7fc700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 0x7f033806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.078+0000 7f034a7fc700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 0x7f033806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f034c0a9df0 tx=0x7f033c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.082+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0340053940 con 0x7f034c0b2f90 2023-08-09T14:15:57.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.283+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f034c074600 con 0x7f034c0b2f90 2023-08-09T14:15:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.284+0000 7f0333fff700 1 -- 172.21.15.5:0/1274953922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f0340056f60 con 0x7f034c0b2f90 2023-08-09T14:15:57.285 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:15:57.286 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:15:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 msgr2=0x7f033806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 0x7f033806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f034c0a9df0 tx=0x7f033c008030 comp rx=0 tx=0).stop 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 msgr2=0x7f034c14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f034000c550 tx=0x7f034000c910 comp rx=0 tx=0).stop 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 shutdown_connections 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f033806a0e0 0x7f033806c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f034c15b1e0 0x7f034c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f034c0b2f90 0x7f034c14dba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 --2- 172.21.15.5:0/1274953922 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f034c0cb590 0x7f034c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 >> 172.21.15.5:0/1274953922 conn(0x7f034c0d0fd0 msgr2=0x7f034c0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 shutdown_connections 2023-08-09T14:15:57.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.286+0000 7f0351863700 1 -- 172.21.15.5:0/1274953922 wait complete. 2023-08-09T14:15:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:15:57.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:15:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.427+0000 7f04e44f4700 1 Processor -- start 2023-08-09T14:15:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.427+0000 7f04e44f4700 1 -- start start 2023-08-09T14:15:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e44f4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e44f4700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f04dc0ce410 0x7f04dc0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e44f4700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0cb2d0 con 0x7f04dc159e90 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e44f4700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0cede0 con 0x7f04dc0ce410 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e44f4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0cb5b0 con 0x7f04dc0b2c70 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e1a8f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f04dc0ce410 0x7f04dc0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e1a8f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:33186/0 (socket says 172.21.15.5:33186) 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2290700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f04dc159e90 0x7f04dc06db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38364/0 (socket says 172.21.15.5:38364) 2023-08-09T14:15:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e1a8f700 1 -- 172.21.15.5:0/2171014069 learned_addr learned my addr 172.21.15.5:0/2171014069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f04dc0ce410 0x7f04dc0ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60650/0 (socket says 172.21.15.5:60650) 2023-08-09T14:15:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 -- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 msgr2=0x7f04dc0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 --2- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 -- 172.21.15.5:0/2171014069 >> v1:172.21.15.101:6789/0 conn(0x7f04dc159e90 legacy=0x7f04dc06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.428+0000 7f04e2a91700 1 -- 172.21.15.5:0/2171014069 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0cb890 con 0x7f04dc0ce410 2023-08-09T14:15:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e2a91700 1 --2- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0ce8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009d90 tx=0x7f04d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81fa7fcbc1d06431 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e128e700 1 -- 172.21.15.5:0/2171014069 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400e070 con 0x7f04dc0ce410 2023-08-09T14:15:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e128e700 1 -- 172.21.15.5:0/2171014069 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400bb20 con 0x7f04dc0ce410 2023-08-09T14:15:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e128e700 1 -- 172.21.15.5:0/2171014069 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4012430 con 0x7f04dc0ce410 2023-08-09T14:15:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 -- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 msgr2=0x7f04dc0ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 --2- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0ce8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009d90 tx=0x7f04d400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 -- 172.21.15.5:0/2171014069 shutdown_connections 2023-08-09T14:15:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 --2- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0ce8a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 --2- 172.21.15.5:0/2171014069 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 -- 172.21.15.5:0/2171014069 >> 172.21.15.5:0/2171014069 conn(0x7f04dc0b1970 msgr2=0x7f04dc0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 -- 172.21.15.5:0/2171014069 shutdown_connections 2023-08-09T14:15:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.429+0000 7f04e44f4700 1 -- 172.21.15.5:0/2171014069 wait complete. 2023-08-09T14:15:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 Processor -- start 2023-08-09T14:15:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 -- start start 2023-08-09T14:15:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c7000 con 0x7f04dc159e90 2023-08-09T14:15:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c7990 con 0x7f04dc0ce410 2023-08-09T14:15:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.431+0000 7f04e44f4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c7210 con 0x7f04dc0b2c70 2023-08-09T14:15:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43612/0 (socket says 172.21.15.5:43612) 2023-08-09T14:15:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 -- 172.21.15.5:0/3356652589 learned_addr learned my addr 172.21.15.5:0/3356652589 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e1a8f700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2290700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 -- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 msgr2=0x7f04dc14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 -- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 msgr2=0x7f04dc0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 -- 172.21.15.5:0/3356652589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009a70 con 0x7f04dc159e90 2023-08-09T14:15:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e2a91700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f04d400b370 tx=0x7f04d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4012430 con 0x7f04dc159e90 2023-08-09T14:15:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4020070 con 0x7f04dc159e90 2023-08-09T14:15:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40098f0 con 0x7f04dc159e90 2023-08-09T14:15:57.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0c74f0 con 0x7f04dc159e90 2023-08-09T14:15:57.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.432+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc0c7e80 con 0x7f04dc159e90 2023-08-09T14:15:57.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.433+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc074600 con 0x7f04dc159e90 2023-08-09T14:15:57.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.434+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f04d4004040 con 0x7f04dc159e90 2023-08-09T14:15:57.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.434+0000 7f04d2ffd700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 0x7f04c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.434+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04d4022070 con 0x7f04dc159e90 2023-08-09T14:15:57.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.434+0000 7f04e2290700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 0x7f04c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.435+0000 7f04e2290700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 0x7f04c006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000f60 tx=0x7f04d8007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.439+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f04d4055890 con 0x7f04dc159e90 2023-08-09T14:15:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.638+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f04dc0cd160 con 0x7f04dc159e90 2023-08-09T14:15:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.638+0000 7f04d2ffd700 1 -- 172.21.15.5:0/3356652589 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f04d4058eb0 con 0x7f04dc159e90 2023-08-09T14:15:57.640 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:15:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 msgr2=0x7f04c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 0x7f04c006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000f60 tx=0x7f04d8007ed0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 msgr2=0x7f04dc15a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f04d400b370 tx=0x7f04d4004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 shutdown_connections 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f04c006a0e0 0x7f04c006c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04dc159e90 0x7f04dc15a5c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f04dc0b2c70 0x7f04dc14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 --2- 172.21.15.5:0/3356652589 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f04dc0ce410 0x7f04dc0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 >> 172.21.15.5:0/3356652589 conn(0x7f04dc0b1970 msgr2=0x7f04dc0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 shutdown_connections 2023-08-09T14:15:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.640+0000 7f04e44f4700 1 -- 172.21.15.5:0/3356652589 wait complete. 2023-08-09T14:15:57.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:15:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.779+0000 7ffa72d61700 1 Processor -- start 2023-08-09T14:15:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.779+0000 7ffa72d61700 1 -- start start 2023-08-09T14:15:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa72d61700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c06a8d0 0x7ffa6c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa72d61700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0715a0 con 0x7ffa6c0cd1c0 2023-08-09T14:15:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa72d61700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0712a0 con 0x7ffa6c15d3a0 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa72d61700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cd6c0 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa712fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c06a8d0 0x7ffa6c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa6bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa6c0cd1c0 0x7ffa6c06a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57034/0 (socket says 172.21.15.5:57034) 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.780+0000 7ffa6bfff700 1 -- 172.21.15.5:0/2941399150 learned_addr learned my addr 172.21.15.5:0/2941399150 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa712fe700 1 -- 172.21.15.5:0/2941399150 >> v1:172.21.15.101:6789/0 conn(0x7ffa6c15d3a0 legacy=0x7ffa6c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa712fe700 1 -- 172.21.15.5:0/2941399150 >> v1:172.21.15.5:6789/0 conn(0x7ffa6c0cd1c0 legacy=0x7ffa6c06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa712fe700 1 -- 172.21.15.5:0/2941399150 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0ce110 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa6b7fe700 1 -- 172.21.15.5:0/2941399150 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169655583 0 0) 0x7ffa6c0715a0 con 0x7ffa6c0cd1c0 2023-08-09T14:15:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa712fe700 1 --2- 172.21.15.5:0/2941399150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c0af2c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c2e4f21397786 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa6b7fe700 1 -- 172.21.15.5:0/2941399150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400e070 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa6b7fe700 1 -- 172.21.15.5:0/2941399150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400bbd0 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.781+0000 7ffa6b7fe700 1 -- 172.21.15.5:0/2941399150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64012430 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 -- 172.21.15.5:0/2941399150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 msgr2=0x7ffa6c0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2941399150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c0af2c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).stop 2023-08-09T14:15:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 -- 172.21.15.5:0/2941399150 shutdown_connections 2023-08-09T14:15:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2941399150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c0af2c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 -- 172.21.15.5:0/2941399150 >> 172.21.15.5:0/2941399150 conn(0x7ffa6c0b1970 msgr2=0x7ffa6c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 -- 172.21.15.5:0/2941399150 shutdown_connections 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.782+0000 7ffa72d61700 1 -- 172.21.15.5:0/2941399150 wait complete. 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.783+0000 7ffa72d61700 1 Processor -- start 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.783+0000 7ffa72d61700 1 -- start start 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0cd1c0 0x7ffa6c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c15d3a0 0x7ffa6c1f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c42a0 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c5e10 con 0x7ffa6c0cd1c0 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c3970 con 0x7ffa6c15d3a0 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43622/0 (socket says 172.21.15.5:43622) 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 -- 172.21.15.5:0/2471130092 learned_addr learned my addr 172.21.15.5:0/2471130092 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 -- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c15d3a0 msgr2=0x7ffa6c1f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c15d3a0 0x7ffa6c1f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 -- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0cd1c0 msgr2=0x7ffa6c0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0cd1c0 0x7ffa6c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 -- 172.21.15.5:0/2471130092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009a70 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa70afd700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c4e0 tx=0x7ffa6000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600052d0 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60005430 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.784+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0c3c50 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.785+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600038c0 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.785+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c1f3920 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.785+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0ceb50 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.786+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa60003a20 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.786+0000 7ffa697fa700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 0x7ffa5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.787+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa60087a50 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.787+0000 7ffa6bfff700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 0x7ffa5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.787+0000 7ffa6bfff700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 0x7ffa5006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa58000c00 tx=0x7ffa58007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.791+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ffa60053140 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.991+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa6c074600 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.992+0000 7ffa697fa700 1 -- 172.21.15.5:0/2471130092 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa60017020 con 0x7ffa6c06a8d0 2023-08-09T14:15:57.993 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:15:57.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 msgr2=0x7ffa5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 0x7ffa5006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa58000c00 tx=0x7ffa58007990 comp rx=0 tx=0).stop 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 msgr2=0x7ffa6c1f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c4e0 tx=0x7ffa6000c8a0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 shutdown_connections 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ffa5006a0e0 0x7ffa5006c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ffa6c15d3a0 0x7ffa6c1f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c06a8d0 0x7ffa6c1f33e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 --2- 172.21.15.5:0/2471130092 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ffa6c0cd1c0 0x7ffa6c0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 >> 172.21.15.5:0/2471130092 conn(0x7ffa6c0b1970 msgr2=0x7ffa6c0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 shutdown_connections 2023-08-09T14:15:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:57.994+0000 7ffa72d61700 1 -- 172.21.15.5:0/2471130092 wait complete. 2023-08-09T14:15:58.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:15:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.135+0000 7f5a497f8700 1 Processor -- start 2023-08-09T14:15:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.135+0000 7f5a497f8700 1 -- start start 2023-08-09T14:15:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a497f8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a440d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a497f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a440d0130 0x7f5a440d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a497f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440b40b0 con 0x7f5a440cfd50 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a497f8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440ce7a0 con 0x7f5a440d0130 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a497f8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440b48c0 con 0x7f5a44160c90 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a437fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a440d0130 0x7f5a440d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a42ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a440cfd50 0x7f5a44160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57046/0 (socket says 172.21.15.5:57046) 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a42ffd700 1 -- 172.21.15.5:0/661455853 learned_addr learned my addr 172.21.15.5:0/661455853 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a427fc700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a440d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a437fe700 1 -- 172.21.15.5:0/661455853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 msgr2=0x7f5a440d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a437fe700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a440d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a437fe700 1 -- 172.21.15.5:0/661455853 >> v1:172.21.15.5:6789/0 conn(0x7f5a440cfd50 legacy=0x7f5a44160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a437fe700 1 -- 172.21.15.5:0/661455853 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440cf180 con 0x7f5a440d0130 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.136+0000 7f5a41ffb700 1 -- 172.21.15.5:0/661455853 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595786249 0 0) 0x7f5a440b40b0 con 0x7f5a440cfd50 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a437fe700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440d0130 0x7f5a440d0cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009d90 tx=0x7f5a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4051bf87eca4fc3d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a41ffb700 1 -- 172.21.15.5:0/661455853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00e070 con 0x7f5a440d0130 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a41ffb700 1 -- 172.21.15.5:0/661455853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00bbd0 con 0x7f5a440d0130 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a41ffb700 1 -- 172.21.15.5:0/661455853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c012430 con 0x7f5a440d0130 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 -- 172.21.15.5:0/661455853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440d0130 msgr2=0x7f5a440d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440d0130 0x7f5a440d0cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009d90 tx=0x7f5a3c00b330 comp rx=0 tx=0).stop 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 -- 172.21.15.5:0/661455853 shutdown_connections 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440d0130 0x7f5a440d0cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 --2- 172.21.15.5:0/661455853 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a440d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 -- 172.21.15.5:0/661455853 >> 172.21.15.5:0/661455853 conn(0x7f5a440d30f0 msgr2=0x7f5a440d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 -- 172.21.15.5:0/661455853 shutdown_connections 2023-08-09T14:15:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.137+0000 7f5a497f8700 1 -- 172.21.15.5:0/661455853 wait complete. 2023-08-09T14:15:58.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.139+0000 7f5a497f8700 1 Processor -- start 2023-08-09T14:15:58.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.139+0000 7f5a497f8700 1 -- start start 2023-08-09T14:15:58.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.139+0000 7f5a497f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.139+0000 7f5a497f8700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5a440d0130 0x7f5a440b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.139+0000 7f5a497f8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a44157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a497f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441577e0 con 0x7f5a440cfd50 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a497f8700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415afe0 con 0x7f5a440d0130 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a497f8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415a6f0 con 0x7f5a44160c90 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43636/0 (socket says 172.21.15.5:43636) 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 -- 172.21.15.5:0/3414017326 learned_addr learned my addr 172.21.15.5:0/3414017326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a437fe700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a44157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a427fc700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5a440d0130 0x7f5a440b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 -- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 msgr2=0x7f5a44157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a44157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 -- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5a440d0130 msgr2=0x7f5a440b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5a440d0130 0x7f5a440b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 -- 172.21.15.5:0/3414017326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009a70 con 0x7f5a440cfd50 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a42ffd700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c580 tx=0x7f5a3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38004c80 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38004e00 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4415a990 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007310 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.140+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44155c80 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.141+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a44074600 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.142+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a38007470 con 0x7f5a440cfd50 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.142+0000 7f5a2b7fe700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 0x7f5a3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.142+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a38088150 con 0x7f5a440cfd50 2023-08-09T14:15:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.142+0000 7f5a427fc700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 0x7f5a3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.143+0000 7f5a427fc700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 0x7f5a3006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a440c9ba0 tx=0x7f5a34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.147+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5a38053840 con 0x7f5a440cfd50 2023-08-09T14:15:58.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.346+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a441606d0 con 0x7f5a440cfd50 2023-08-09T14:15:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.346+0000 7f5a2b7fe700 1 -- 172.21.15.5:0/3414017326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a38056e60 con 0x7f5a440cfd50 2023-08-09T14:15:58.348 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:15:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 msgr2=0x7f5a3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 0x7f5a3006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a440c9ba0 tx=0x7f5a34008040 comp rx=0 tx=0).stop 2023-08-09T14:15:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 msgr2=0x7f5a44155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c580 tx=0x7f5a3800c890 comp rx=0 tx=0).stop 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 shutdown_connections 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5a3006a0e0 0x7f5a3006c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5a44160c90 0x7f5a44157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a440cfd50 0x7f5a44155740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 --2- 172.21.15.5:0/3414017326 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5a440d0130 0x7f5a440b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 >> 172.21.15.5:0/3414017326 conn(0x7f5a440d30f0 msgr2=0x7f5a4415e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:58.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 shutdown_connections 2023-08-09T14:15:58.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.349+0000 7f5a497f8700 1 -- 172.21.15.5:0/3414017326 wait complete. 2023-08-09T14:15:58.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:15:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.489+0000 7f5d8fcda700 1 Processor -- start 2023-08-09T14:15:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.489+0000 7f5d8fcda700 1 -- start start 2023-08-09T14:15:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8fcda700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d8815b280 0x7f5d880b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8fcda700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d8815b660 0x7f5d880cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8fcda700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880b4180 con 0x7f5d880cfff0 2023-08-09T14:15:58.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8fcda700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880b53f0 con 0x7f5d8815b660 2023-08-09T14:15:58.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8fcda700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88066300 con 0x7f5d8815b280 2023-08-09T14:15:58.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8d275700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d8815b660 0x7f5d880cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8e277700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5d880cfff0 0x7f5d880cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57064/0 (socket says 172.21.15.5:57064) 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8e277700 1 -- 172.21.15.5:0/1444142700 learned_addr learned my addr 172.21.15.5:0/1444142700 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.490+0000 7f5d8da76700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d8815b280 0x7f5d880b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8d275700 1 -- 172.21.15.5:0/1444142700 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d8815b280 msgr2=0x7f5d880b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8d275700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d8815b280 0x7f5d880b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8d275700 1 -- 172.21.15.5:0/1444142700 >> v1:172.21.15.5:6789/0 conn(0x7f5d880cfff0 legacy=0x7f5d880cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8ca74700 1 -- 172.21.15.5:0/1444142700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841106342 0 0) 0x7f5d880b4180 con 0x7f5d880cfff0 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8d275700 1 -- 172.21.15.5:0/1444142700 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880b43d0 con 0x7f5d8815b660 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8d275700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b660 0x7f5d880cbd50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009840 tx=0x7f5d84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340eeebab07b6bc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8ca74700 1 -- 172.21.15.5:0/1444142700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011830 con 0x7f5d8815b660 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8ca74700 1 -- 172.21.15.5:0/1444142700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84011990 con 0x7f5d8815b660 2023-08-09T14:15:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8ca74700 1 -- 172.21.15.5:0/1444142700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011d20 con 0x7f5d8815b660 2023-08-09T14:15:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1444142700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b660 msgr2=0x7f5d880cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b660 0x7f5d880cbd50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009840 tx=0x7f5d84009b50 comp rx=0 tx=0).stop 2023-08-09T14:15:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1444142700 shutdown_connections 2023-08-09T14:15:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d8815b280 0x7f5d880b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1444142700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b660 0x7f5d880cbd50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.491+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1444142700 >> 172.21.15.5:0/1444142700 conn(0x7f5d880cf4d0 msgr2=0x7f5d880cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.492+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1444142700 shutdown_connections 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.492+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1444142700 wait complete. 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 Processor -- start 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 -- start start 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 0x7f5d88156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 0x7f5d8806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880b0b90 con 0x7f5d8815b280 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880affc0 con 0x7f5d8815b660 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.493+0000 7f5d8fcda700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8806ddb0 con 0x7f5d880cfff0 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43654/0 (socket says 172.21.15.5:43654) 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 -- 172.21.15.5:0/1278769140 learned_addr learned my addr 172.21.15.5:0/1278769140 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8da76700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 0x7f5d88156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8e277700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 0x7f5d8806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 -- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 msgr2=0x7f5d88156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 0x7f5d88156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 -- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 msgr2=0x7f5d8806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 0x7f5d8806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 -- 172.21.15.5:0/1278769140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840094a0 con 0x7f5d8815b280 2023-08-09T14:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8e277700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 0x7f5d8806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8da76700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 0x7f5d88156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8d275700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d840090b0 tx=0x7f5d84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840038a0 con 0x7f5d8815b280 2023-08-09T14:15:58.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8401f070 con 0x7f5d8815b280 2023-08-09T14:15:58.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d880b0260 con 0x7f5d8815b280 2023-08-09T14:15:58.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84003c00 con 0x7f5d8815b280 2023-08-09T14:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.494+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d880b0820 con 0x7f5d8815b280 2023-08-09T14:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.495+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d880b0d00 con 0x7f5d8815b280 2023-08-09T14:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.496+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d8401a430 con 0x7f5d8815b280 2023-08-09T14:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.497+0000 7f5d7e7fc700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 0x7f5d6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.497+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d84021070 con 0x7f5d8815b280 2023-08-09T14:15:58.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.497+0000 7f5d8da76700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 0x7f5d6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.497+0000 7f5d8da76700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 0x7f5d6c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009c10 tx=0x7f5d78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.501+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5d84055970 con 0x7f5d8815b280 2023-08-09T14:15:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.701+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d88074600 con 0x7f5d8815b280 2023-08-09T14:15:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.701+0000 7f5d7e7fc700 1 -- 172.21.15.5:0/1278769140 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d84058f90 con 0x7f5d8815b280 2023-08-09T14:15:58.704 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:15:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 msgr2=0x7f5d6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 0x7f5d6c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009c10 tx=0x7f5d78008040 comp rx=0 tx=0).stop 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 msgr2=0x7f5d88156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d840090b0 tx=0x7f5d84004750 comp rx=0 tx=0).stop 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 shutdown_connections 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5d6c06a0e0 0x7f5d6c06c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5d8815b660 0x7f5d8806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5d880cfff0 0x7f5d88156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 --2- 172.21.15.5:0/1278769140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8815b280 0x7f5d88156b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 >> 172.21.15.5:0/1278769140 conn(0x7f5d880cf4d0 msgr2=0x7f5d881e39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 shutdown_connections 2023-08-09T14:15:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.704+0000 7f5d8fcda700 1 -- 172.21.15.5:0/1278769140 wait complete. 2023-08-09T14:15:58.746 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-09T14:15:58.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-08-09T14:15:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.871+0000 7feec5108700 1 Processor -- start 2023-08-09T14:15:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.871+0000 7feec5108700 1 -- start start 2023-08-09T14:15:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feec5108700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cdea0 0x7feec00b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feec5108700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feec00cea90 0x7feec00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feec5108700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00cfc10 con 0x7feec015e750 2023-08-09T14:15:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feec5108700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec00cf000 con 0x7feec00cea90 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feec5108700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00cf2e0 con 0x7feec00cdea0 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feebed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feec015e750 0x7feec00cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57074/0 (socket says 172.21.15.5:57074) 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feebed9d700 1 -- 172.21.15.5:0/537548397 learned_addr learned my addr 172.21.15.5:0/537548397 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feebf59e700 1 --2- 172.21.15.5:0/537548397 >> v2:172.21.15.5:3300/0 conn(0x7feec00cea90 0x7feec00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.872+0000 7feebe59c700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cdea0 0x7feec00b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebdd9b700 1 -- 172.21.15.5:0/537548397 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179778124 0 0) 0x7feec00cfc10 con 0x7feec015e750 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebdd9b700 1 -- 172.21.15.5:0/537548397 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac0035b0 con 0x7feec015e750 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebf59e700 1 -- 172.21.15.5:0/537548397 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cdea0 msgr2=0x7feec00b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebf59e700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cdea0 0x7feec00b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebf59e700 1 -- 172.21.15.5:0/537548397 >> v1:172.21.15.5:6789/0 conn(0x7feec015e750 legacy=0x7feec00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebf59e700 1 -- 172.21.15.5:0/537548397 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00cf5c0 con 0x7feec00cea90 2023-08-09T14:15:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebf59e700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec00cea90 0x7feec00b4250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009d90 tx=0x7feeb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e236f725845f5b84 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebdd9b700 1 -- 172.21.15.5:0/537548397 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800e070 con 0x7feec00cea90 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebdd9b700 1 -- 172.21.15.5:0/537548397 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800bb20 con 0x7feec00cea90 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feebdd9b700 1 -- 172.21.15.5:0/537548397 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8012430 con 0x7feec00cea90 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feec5108700 1 -- 172.21.15.5:0/537548397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec00cea90 msgr2=0x7feec00b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.873+0000 7feec5108700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec00cea90 0x7feec00b4250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009d90 tx=0x7feeb800b330 comp rx=0 tx=0).stop 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 -- 172.21.15.5:0/537548397 shutdown_connections 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec00cea90 0x7feec00b4250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 --2- 172.21.15.5:0/537548397 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cdea0 0x7feec00b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 -- 172.21.15.5:0/537548397 >> 172.21.15.5:0/537548397 conn(0x7feec009a180 msgr2=0x7feec00d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 -- 172.21.15.5:0/537548397 shutdown_connections 2023-08-09T14:15:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.874+0000 7feec5108700 1 -- 172.21.15.5:0/537548397 wait complete. 2023-08-09T14:15:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.875+0000 7feec5108700 1 Processor -- start 2023-08-09T14:15:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.875+0000 7feec5108700 1 -- start start 2023-08-09T14:15:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 0x7feec0152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 0x7feec01e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01f4d20 con 0x7feec015e750 2023-08-09T14:15:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01514a0 con 0x7feec00cdea0 2023-08-09T14:15:58.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feec5108700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec01516f0 con 0x7feec00cea90 2023-08-09T14:15:58.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43668/0 (socket says 172.21.15.5:43668) 2023-08-09T14:15:58.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 -- 172.21.15.5:0/4102038952 learned_addr learned my addr 172.21.15.5:0/4102038952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:15:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebed9d700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 0x7feec0152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebe59c700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 0x7feec01e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 -- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 msgr2=0x7feec01e4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 0x7feec01e4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 -- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 msgr2=0x7feec0152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 0x7feec0152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 -- 172.21.15.5:0/4102038952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8009a70 con 0x7feec015e750 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebe59c700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 0x7feec01e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebed9d700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 0x7feec0152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.876+0000 7feebf59e700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feeb8014040 tx=0x7feeb8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.877+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8012430 con 0x7feec015e750 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.877+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8020070 con 0x7feec015e750 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.877+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec01519d0 con 0x7feec015e750 2023-08-09T14:15:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.877+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8004280 con 0x7feec015e750 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.877+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec0151f90 con 0x7feec015e750 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.878+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec0074600 con 0x7feec015e750 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.878+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feeb80043e0 con 0x7feec015e750 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.878+0000 7feeb77fe700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 0x7feea006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.879+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feeb8022070 con 0x7feec015e750 2023-08-09T14:15:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.879+0000 7feebed9d700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 0x7feea006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:15:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.879+0000 7feebed9d700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 0x7feea006c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb00011e0 tx=0x7feeb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:15:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:58.883+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feeb8055d80 con 0x7feec015e750 2023-08-09T14:15:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.168+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7feec00d1cc0 con 0x7feec015e750 2023-08-09T14:15:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.933+0000 7feeb77fe700 1 -- 172.21.15.5:0/4102038952 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v49) v1 ==== 147+0+0 (secure 0 0 0) 0x7feeb80593a0 con 0x7feec015e750 2023-08-09T14:15:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 msgr2=0x7feea006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 0x7feea006c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb00011e0 tx=0x7feeb0009040 comp rx=0 tx=0).stop 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 msgr2=0x7feec00c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feeb8014040 tx=0x7feeb8004ad0 comp rx=0 tx=0).stop 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 shutdown_connections 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feea006a0e0 0x7feea006c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec015e750 0x7feec00c8f90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feec00cdea0 0x7feec0152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 --2- 172.21.15.5:0/4102038952 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feec00cea90 0x7feec01e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:15:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 >> 172.21.15.5:0/4102038952 conn(0x7feec009a180 msgr2=0x7feec0154860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:15:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 shutdown_connections 2023-08-09T14:15:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:15:59.936+0000 7feec5108700 1 -- 172.21.15.5:0/4102038952 wait complete. 2023-08-09T14:15:59.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.083+0000 7fb2a12f7700 1 Processor -- start 2023-08-09T14:16:00.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.083+0000 7fb2a12f7700 1 -- start start 2023-08-09T14:16:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb2a12f7700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fb29c15d400 0x7fb29c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb2a12f7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c06e850 con 0x7fb29c06a1c0 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb2a12f7700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c06db70 con 0x7fb29c06a640 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb2a12f7700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c06aad0 con 0x7fb29c15d400 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb29a7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb29c06a1c0 0x7fb29c06cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57088/0 (socket says 172.21.15.5:57088) 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb29a7fc700 1 -- 172.21.15.5:0/1094690824 learned_addr learned my addr 172.21.15.5:0/1094690824 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb29affd700 1 --2- 172.21.15.5:0/1094690824 >> v2:172.21.15.101:3300/0 conn(0x7fb29c15d400 0x7fb29c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.084+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335873539 0 0) 0x7fb29c06e850 con 0x7fb29c06a1c0 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2840035b0 con 0x7fb29c06a1c0 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479432030 0 0) 0x7fb2840035b0 con 0x7fb29c06a1c0 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 >> v2:172.21.15.101:3300/0 conn(0x7fb29c15d400 msgr2=0x7fb29c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 --2- 172.21.15.5:0/1094690824 >> v2:172.21.15.101:3300/0 conn(0x7fb29c15d400 0x7fb29c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 >> v1:172.21.15.101:6789/0 conn(0x7fb29c06a640 legacy=0x7fb29c06d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0cf7b0 con 0x7fb29c06a1c0 2023-08-09T14:16:00.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fb28c001670 con 0x7fb29c06a1c0 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 >> v1:172.21.15.5:6789/0 conn(0x7fb29c06a1c0 legacy=0x7fb29c06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c06aad0 con 0x7fb284005210 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28400c0b0 con 0x7fb284004850 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28400c270 con 0x7fb284003a00 2023-08-09T14:16:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29a7fc700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29affd700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb284003a00 msgr2=0x7fb284003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb284004850 msgr2=0x7fb284004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1094690824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840035b0 con 0x7fb284005210 2023-08-09T14:16:00.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29affd700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.085+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1094690824 reap_dead start 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb28400ba10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c190 tx=0x7fb284005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e072a8e80d97436d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294001db0 con 0x7fb284005210 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400ccf0 con 0x7fb284005210 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb299ffb700 1 -- 172.21.15.5:0/1094690824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294003c40 con 0x7fb284005210 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 -- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 msgr2=0x7fb28400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb28400ba10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c190 tx=0x7fb284005880 comp rx=0 tx=0).stop 2023-08-09T14:16:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 -- 172.21.15.5:0/1094690824 shutdown_connections 2023-08-09T14:16:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/1094690824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 -- 172.21.15.5:0/1094690824 >> 172.21.15.5:0/1094690824 conn(0x7fb29c0b1900 msgr2=0x7fb29c0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 -- 172.21.15.5:0/1094690824 shutdown_connections 2023-08-09T14:16:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.086+0000 7fb2a12f7700 1 -- 172.21.15.5:0/1094690824 wait complete. 2023-08-09T14:16:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.088+0000 7fb2a12f7700 1 Processor -- start 2023-08-09T14:16:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.088+0000 7fb2a12f7700 1 -- start start 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.088+0000 7fb2a12f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.088+0000 7fb2a12f7700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb29c0cff40 0x7fb29c1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb29c0d03c0 0x7fb29c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1f68f0 con 0x7fb284005210 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c15f350 con 0x7fb29c0d03c0 2023-08-09T14:16:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1f6330 con 0x7fb29c0cff40 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43684/0 (socket says 172.21.15.5:43684) 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 -- 172.21.15.5:0/464743796 learned_addr learned my addr 172.21.15.5:0/464743796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29a7fc700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb29c0cff40 0x7fb29c1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb29c0d03c0 0x7fb29c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 -- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb29c0cff40 msgr2=0x7fb29c1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb29c0cff40 0x7fb29c1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 -- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb29c0d03c0 msgr2=0x7fb29c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb29c0d03c0 0x7fb29c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 -- 172.21.15.5:0/464743796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c1f6610 con 0x7fb284005210 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb29affd700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb290010850 tx=0x7fb290010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290004020 con 0x7fb284005210 2023-08-09T14:16:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290004180 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c15efe0 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290004510 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.089+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c15b520 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.090+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c15ee40 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.091+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2900036a0 con 0x7fb284005210 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.091+0000 7fb2837fe700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.091+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2900886f0 con 0x7fb284005210 2023-08-09T14:16:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.092+0000 7fb29a7fc700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.092+0000 7fb29a7fc700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 0x7fb28806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb28c001c90 tx=0x7fb28c000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.096+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb29c15ee40 con 0x7fb284005210 2023-08-09T14:16:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.297+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb29c15f630 con 0x7fb284005210 2023-08-09T14:16:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.298+0000 7fb2837fe700 1 -- 172.21.15.5:0/464743796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fb290057900 con 0x7fb284005210 2023-08-09T14:16:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:00.300 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 msgr2=0x7fb28806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 0x7fb28806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb28c001c90 tx=0x7fb28c000ed0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 msgr2=0x7fb29c15f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb290010850 tx=0x7fb290010b60 comp rx=0 tx=0).stop 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 shutdown_connections 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb29c0d03c0 0x7fb29c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb284005210 0x7fb29c15f7e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 --2- 172.21.15.5:0/464743796 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb29c0cff40 0x7fb29c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 >> 172.21.15.5:0/464743796 conn(0x7fb29c0b1900 msgr2=0x7fb29c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 shutdown_connections 2023-08-09T14:16:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.300+0000 7fb2a12f7700 1 -- 172.21.15.5:0/464743796 wait complete. 2023-08-09T14:16:00.314 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:00.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:00.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.441+0000 7effb3d4a700 1 Processor -- start 2023-08-09T14:16:00.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.441+0000 7effb3d4a700 1 -- start start 2023-08-09T14:16:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb3d4a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effac06a8d0 0x7effac0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb3d4a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0715a0 con 0x7effac15d3a0 2023-08-09T14:16:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb3d4a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0712a0 con 0x7effac0cd1c0 2023-08-09T14:16:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb3d4a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0cd6c0 con 0x7effac06a8d0 2023-08-09T14:16:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb22e7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effac06a8d0 0x7effac0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb1ae6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effac15d3a0 0x7effac0cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57108/0 (socket says 172.21.15.5:57108) 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb22e7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effac06a8d0 0x7effac0af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43696/0 (socket says 172.21.15.5:43696) 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb1ae6700 1 -- 172.21.15.5:0/2517121677 learned_addr learned my addr 172.21.15.5:0/2517121677 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb22e7700 1 -- 172.21.15.5:0/2517121677 >> v1:172.21.15.101:6789/0 conn(0x7effac0cd1c0 legacy=0x7effac06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb22e7700 1 -- 172.21.15.5:0/2517121677 >> v1:172.21.15.5:6789/0 conn(0x7effac15d3a0 legacy=0x7effac0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb22e7700 1 -- 172.21.15.5:0/2517121677 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0ce110 con 0x7effac06a8d0 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.442+0000 7effb0ae4700 1 -- 172.21.15.5:0/2517121677 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103271490 0 0) 0x7effac0715a0 con 0x7effac15d3a0 2023-08-09T14:16:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb22e7700 1 --2- 172.21.15.5:0/2517121677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac06a8d0 0x7effac0af2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effa4009d90 tx=0x7effa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cb3a54779adf8a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb0ae4700 1 -- 172.21.15.5:0/2517121677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400e070 con 0x7effac06a8d0 2023-08-09T14:16:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb0ae4700 1 -- 172.21.15.5:0/2517121677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400bbd0 con 0x7effac06a8d0 2023-08-09T14:16:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb0ae4700 1 -- 172.21.15.5:0/2517121677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4012430 con 0x7effac06a8d0 2023-08-09T14:16:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 -- 172.21.15.5:0/2517121677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac06a8d0 msgr2=0x7effac0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 --2- 172.21.15.5:0/2517121677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac06a8d0 0x7effac0af2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effa4009d90 tx=0x7effa400b330 comp rx=0 tx=0).stop 2023-08-09T14:16:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 -- 172.21.15.5:0/2517121677 shutdown_connections 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 --2- 172.21.15.5:0/2517121677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac06a8d0 0x7effac0af2c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 -- 172.21.15.5:0/2517121677 >> 172.21.15.5:0/2517121677 conn(0x7effac0b1970 msgr2=0x7effac0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 -- 172.21.15.5:0/2517121677 shutdown_connections 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.443+0000 7effb3d4a700 1 -- 172.21.15.5:0/2517121677 wait complete. 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.445+0000 7effb3d4a700 1 Processor -- start 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.445+0000 7effb3d4a700 1 -- start start 2023-08-09T14:16:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7effac06a8d0 0x7effac151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7effac0cd1c0 0x7effac0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0b5570 con 0x7effac15d3a0 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0b57a0 con 0x7effac0cd1c0 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb3d4a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac15da30 con 0x7effac06a8d0 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43702/0 (socket says 172.21.15.5:43702) 2023-08-09T14:16:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 -- 172.21.15.5:0/472565435 learned_addr learned my addr 172.21.15.5:0/472565435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb1ae6700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7effac06a8d0 0x7effac151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb12e5700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7effac0cd1c0 0x7effac0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 -- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7effac06a8d0 msgr2=0x7effac151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7effac06a8d0 0x7effac151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 -- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7effac0cd1c0 msgr2=0x7effac0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7effac0cd1c0 0x7effac0b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.446+0000 7effb22e7700 1 -- 172.21.15.5:0/472565435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009a70 con 0x7effac15d3a0 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effb22e7700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7effa4014040 tx=0x7effa4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4012430 con 0x7effac15d3a0 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa4020070 con 0x7effac15d3a0 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4004280 con 0x7effac15d3a0 2023-08-09T14:16:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac15dd10 con 0x7effac15d3a0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.447+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac15e2d0 con 0x7effac15d3a0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.448+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0ceb30 con 0x7effac15d3a0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.448+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effa40043e0 con 0x7effac15d3a0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.449+0000 7effa27fc700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 0x7eff9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.449+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7effa4022070 con 0x7effac15d3a0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.449+0000 7effb1ae6700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 0x7eff9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.449+0000 7effb1ae6700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 0x7eff9006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007b10 tx=0x7eff9c007a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.453+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7effa40559e0 con 0x7effac15d3a0 2023-08-09T14:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.652+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effac074600 con 0x7effac15d3a0 2023-08-09T14:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.652+0000 7effa27fc700 1 -- 172.21.15.5:0/472565435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7effa4059000 con 0x7effac15d3a0 2023-08-09T14:16:00.654 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 msgr2=0x7eff9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 0x7eff9006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007b10 tx=0x7eff9c007a60 comp rx=0 tx=0).stop 2023-08-09T14:16:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 msgr2=0x7effac0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7effa4014040 tx=0x7effa4004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 shutdown_connections 2023-08-09T14:16:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7eff9006a0e0 0x7eff9006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effac15d3a0 0x7effac0b5030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7effac06a8d0 0x7effac151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 --2- 172.21.15.5:0/472565435 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7effac0cd1c0 0x7effac0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 >> 172.21.15.5:0/472565435 conn(0x7effac0b1970 msgr2=0x7effac0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 shutdown_connections 2023-08-09T14:16:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.654+0000 7effb3d4a700 1 -- 172.21.15.5:0/472565435 wait complete. 2023-08-09T14:16:00.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.795+0000 7f99a5a36700 1 Processor -- start 2023-08-09T14:16:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.795+0000 7f99a5a36700 1 -- start start 2023-08-09T14:16:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f99a5a36700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f99a5a36700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f99a5a36700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00cb2d0 con 0x7f99a00ce410 2023-08-09T14:16:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f99a5a36700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00cb5b0 con 0x7f99a0159e90 2023-08-09T14:16:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f99a5a36700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00cb890 con 0x7f99a00b2c70 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999effd700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999f7fe700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f99a00ce410 0x7f99a0070d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38472/0 (socket says 172.21.15.5:38472) 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999effd700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60750/0 (socket says 172.21.15.5:60750) 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:33290/0 (socket says 172.21.15.5:33290) 2023-08-09T14:16:00.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999f7fe700 1 -- 172.21.15.5:0/3090561371 learned_addr learned my addr 172.21.15.5:0/3090561371 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 -- 172.21.15.5:0/3090561371 >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 msgr2=0x7f99a00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 --2- 172.21.15.5:0/3090561371 >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 -- 172.21.15.5:0/3090561371 >> v1:172.21.15.101:6789/0 conn(0x7f99a00ce410 legacy=0x7f99a0070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999e7fc700 1 -- 172.21.15.5:0/3090561371 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00cbb70 con 0x7f99a00b2c70 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999dffb700 1 -- 172.21.15.5:0/3090561371 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544768761 0 0) 0x7f99a00cb2d0 con 0x7f99a00ce410 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.797+0000 7f999effd700 1 --2- 172.21.15.5:0/3090561371 >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f999e7fc700 1 --2- 172.21.15.5:0/3090561371 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9990009840 tx=0x7f9990009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8992d01364ec78cc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f999dffb700 1 -- 172.21.15.5:0/3090561371 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990011830 con 0x7f99a00b2c70 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f999dffb700 1 -- 172.21.15.5:0/3090561371 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990011990 con 0x7f99a00b2c70 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f999dffb700 1 -- 172.21.15.5:0/3090561371 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990011d20 con 0x7f99a00b2c70 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 -- 172.21.15.5:0/3090561371 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 msgr2=0x7f99a006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 --2- 172.21.15.5:0/3090561371 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9990009840 tx=0x7f9990009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 -- 172.21.15.5:0/3090561371 shutdown_connections 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 --2- 172.21.15.5:0/3090561371 >> v2:172.21.15.101:3300/0 conn(0x7f99a0159e90 0x7f99a00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 --2- 172.21.15.5:0/3090561371 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a006db30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 -- 172.21.15.5:0/3090561371 >> 172.21.15.5:0/3090561371 conn(0x7f99a00b1970 msgr2=0x7f99a00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:00.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 -- 172.21.15.5:0/3090561371 shutdown_connections 2023-08-09T14:16:00.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.798+0000 7f99a5a36700 1 -- 172.21.15.5:0/3090561371 wait complete. 2023-08-09T14:16:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.800+0000 7f99a5a36700 1 Processor -- start 2023-08-09T14:16:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.800+0000 7f99a5a36700 1 -- start start 2023-08-09T14:16:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a0151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f99a0159e90 0x7f99a00c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a015aab0 con 0x7f99a00ce410 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a015b5f0 con 0x7f99a0159e90 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f99a5a36700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a015acc0 con 0x7f99a00b2c70 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f999e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f999e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43714/0 (socket says 172.21.15.5:43714) 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f999e7fc700 1 -- 172.21.15.5:0/176382467 learned_addr learned my addr 172.21.15.5:0/176382467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f999effd700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a0151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.801+0000 7f999f7fe700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f99a0159e90 0x7f99a00c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 -- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 msgr2=0x7f99a0151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a0151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 -- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f99a0159e90 msgr2=0x7f99a00c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f99a0159e90 0x7f99a00c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 -- 172.21.15.5:0/176382467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940094a0 con 0x7f99a00ce410 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f999e7fc700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99900090b0 tx=0x7f9990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900036a0 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999001f070 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99900094a0 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990003a60 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.802+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a015b280 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.803+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0074600 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.803+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9990003bc0 con 0x7f99a00ce410 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.804+0000 7f9987fff700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 0x7f998c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.804+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9990021070 con 0x7f99a00ce410 2023-08-09T14:16:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.804+0000 7f999effd700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 0x7f998c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.805+0000 7f999effd700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 0x7f998c06c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9994009cd0 tx=0x7f9994009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:00.808+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f99900554b0 con 0x7f99a00ce410 2023-08-09T14:16:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.012+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99a015b730 con 0x7f99a00ce410 2023-08-09T14:16:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.012+0000 7f9987fff700 1 -- 172.21.15.5:0/176382467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99900150a0 con 0x7f99a00ce410 2023-08-09T14:16:01.014 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.014+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 msgr2=0x7f998c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 0x7f998c06c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9994009cd0 tx=0x7f9994009210 comp rx=0 tx=0).stop 2023-08-09T14:16:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 msgr2=0x7f99a00c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99900090b0 tx=0x7f9990004750 comp rx=0 tx=0).stop 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 shutdown_connections 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f998c06a0e0 0x7f998c06c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f99a0159e90 0x7f99a00c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f99a00b2c70 0x7f99a0151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 --2- 172.21.15.5:0/176382467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00ce410 0x7f99a00c9020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 >> 172.21.15.5:0/176382467 conn(0x7f99a00b1970 msgr2=0x7f99a00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 shutdown_connections 2023-08-09T14:16:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.015+0000 7f99a5a36700 1 -- 172.21.15.5:0/176382467 wait complete. 2023-08-09T14:16:01.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 Processor -- start 2023-08-09T14:16:01.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 -- start start 2023-08-09T14:16:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 0x7f296815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29680cb4b0 0x7f29680b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f2968151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296815fc90 con 0x7f29680cb4b0 2023-08-09T14:16:01.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680cf990 con 0x7f29680b6170 2023-08-09T14:16:01.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.155+0000 7f296e9a2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680b3290 con 0x7f29680b2e20 2023-08-09T14:16:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29680cb4b0 0x7f29680b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29680cb4b0 0x7f29680b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43720/0 (socket says 172.21.15.5:43720) 2023-08-09T14:16:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 -- 172.21.15.5:0/143329394 learned_addr learned my addr 172.21.15.5:0/143329394 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f296cf3f700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f2968151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f2967fff700 1 --2- 172.21.15.5:0/143329394 >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 0x7f296815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 -- 172.21.15.5:0/143329394 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 msgr2=0x7f2968151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f2968151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 -- 172.21.15.5:0/143329394 >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 msgr2=0x7f296815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 --2- 172.21.15.5:0/143329394 >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 0x7f296815f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 -- 172.21.15.5:0/143329394 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680cf500 con 0x7f29680cb4b0 2023-08-09T14:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f296cf3f700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f2968151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f2967fff700 1 --2- 172.21.15.5:0/143329394 >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 0x7f296815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f29677fe700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680cb4b0 0x7f29680b28e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29680ce9e0 tx=0x7f295c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158d07d465c658af server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f2966ffd700 1 -- 172.21.15.5:0/143329394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00b9e0 con 0x7f29680cb4b0 2023-08-09T14:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f2966ffd700 1 -- 172.21.15.5:0/143329394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00bb40 con 0x7f29680cb4b0 2023-08-09T14:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.156+0000 7f2966ffd700 1 -- 172.21.15.5:0/143329394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c009e70 con 0x7f29680cb4b0 2023-08-09T14:16:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 -- 172.21.15.5:0/143329394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680cb4b0 msgr2=0x7f29680b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680cb4b0 0x7f29680b28e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29680ce9e0 tx=0x7f295c009c30 comp rx=0 tx=0).stop 2023-08-09T14:16:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 -- 172.21.15.5:0/143329394 shutdown_connections 2023-08-09T14:16:01.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 --2- 172.21.15.5:0/143329394 >> v2:172.21.15.101:3300/0 conn(0x7f29680b6170 0x7f296815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f2968151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 --2- 172.21.15.5:0/143329394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680cb4b0 0x7f29680b28e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 -- 172.21.15.5:0/143329394 >> 172.21.15.5:0/143329394 conn(0x7f296806dec0 msgr2=0x7f296806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 -- 172.21.15.5:0/143329394 shutdown_connections 2023-08-09T14:16:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.157+0000 7f296e9a2700 1 -- 172.21.15.5:0/143329394 wait complete. 2023-08-09T14:16:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.158+0000 7f296e9a2700 1 Processor -- start 2023-08-09T14:16:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.158+0000 7f296e9a2700 1 -- start start 2023-08-09T14:16:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f29680cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29680cb4b0 0x7f2968151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680cb150 con 0x7f29680b6170 2023-08-09T14:16:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680b4ac0 con 0x7f29680cb4b0 2023-08-09T14:16:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296e9a2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296815e160 con 0x7f29680b2e20 2023-08-09T14:16:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43728/0 (socket says 172.21.15.5:43728) 2023-08-09T14:16:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 -- 172.21.15.5:0/2529270907 learned_addr learned my addr 172.21.15.5:0/2529270907 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f2967fff700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f29680cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f296cf3f700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29680cb4b0 0x7f2968151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 -- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 msgr2=0x7f29680cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f29680cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 -- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29680cb4b0 msgr2=0x7f2968151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29680cb4b0 0x7f2968151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.159+0000 7f29677fe700 1 -- 172.21.15.5:0/2529270907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009550 con 0x7f29680b6170 2023-08-09T14:16:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f29677fe700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f295c014040 tx=0x7f295c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c004380 con 0x7f29680b6170 2023-08-09T14:16:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c01f070 con 0x7f29680b6170 2023-08-09T14:16:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681522e0 con 0x7f29680b6170 2023-08-09T14:16:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0036a0 con 0x7f29680b6170 2023-08-09T14:16:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.160+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296815d140 con 0x7f29680b6170 2023-08-09T14:16:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.161+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968074600 con 0x7f29680b6170 2023-08-09T14:16:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.161+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f295c021030 con 0x7f29680b6170 2023-08-09T14:16:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.162+0000 7f2964ff9700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.162+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f295c0899f0 con 0x7f29680b6170 2023-08-09T14:16:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.162+0000 7f2967fff700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.163+0000 7f2967fff700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 0x7f295406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2958006fd0 tx=0x7f2958008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.166+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f295c0551f0 con 0x7f29680b6170 2023-08-09T14:16:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.363+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f296815e670 con 0x7f29680b6170 2023-08-09T14:16:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.363+0000 7f2964ff9700 1 -- 172.21.15.5:0/2529270907 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f295c058810 con 0x7f29680b6170 2023-08-09T14:16:01.365 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:01.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 msgr2=0x7f295406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 0x7f295406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2958006fd0 tx=0x7f2958008040 comp rx=0 tx=0).stop 2023-08-09T14:16:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 msgr2=0x7f296815dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f295c014040 tx=0x7f295c004750 comp rx=0 tx=0).stop 2023-08-09T14:16:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 shutdown_connections 2023-08-09T14:16:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29680cb4b0 0x7f2968151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29680b2e20 0x7f29680cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 --2- 172.21.15.5:0/2529270907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29680b6170 0x7f296815dc20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 >> 172.21.15.5:0/2529270907 conn(0x7f296806dec0 msgr2=0x7f29680b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.365+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 shutdown_connections 2023-08-09T14:16:01.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.366+0000 7f296e9a2700 1 -- 172.21.15.5:0/2529270907 wait complete. 2023-08-09T14:16:01.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.505+0000 7f9a10e06700 1 Processor -- start 2023-08-09T14:16:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.505+0000 7f9a10e06700 1 -- start start 2023-08-09T14:16:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.506+0000 7f9a10e06700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c15b130 0x7f9a0c0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.506+0000 7f9a10e06700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.506+0000 7f9a10e06700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0ca850 con 0x7f9a0c06d930 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.506+0000 7f9a10e06700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c06af60 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.506+0000 7f9a10e06700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c06ddc0 con 0x7f9a0c15b130 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43734/0 (socket says 172.21.15.5:43734) 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 -- 172.21.15.5:0/4158087205 learned_addr learned my addr 172.21.15.5:0/4158087205 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a0a59c700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c15b130 0x7f9a0c0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 -- 172.21.15.5:0/4158087205 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c15b130 msgr2=0x7f9a0c0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c15b130 0x7f9a0c0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 -- 172.21.15.5:0/4158087205 >> v1:172.21.15.101:6789/0 conn(0x7f9a0c06d930 legacy=0x7f9a0c0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 -- 172.21.15.5:0/4158087205 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c06a1c0 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a09d9b700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f99f40098f0 tx=0x7f99f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd09d5b3ed670e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a0959a700 1 -- 172.21.15.5:0/4158087205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400b8a0 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a0959a700 1 -- 172.21.15.5:0/4158087205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400ba00 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.507+0000 7f9a0959a700 1 -- 172.21.15.5:0/4158087205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400bd90 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 -- 172.21.15.5:0/4158087205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 msgr2=0x7f9a0c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f99f40098f0 tx=0x7f99f4009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 -- 172.21.15.5:0/4158087205 shutdown_connections 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c15b130 0x7f9a0c0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 --2- 172.21.15.5:0/4158087205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c06d3f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 -- 172.21.15.5:0/4158087205 >> 172.21.15.5:0/4158087205 conn(0x7f9a0c0b1970 msgr2=0x7f9a0c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 -- 172.21.15.5:0/4158087205 shutdown_connections 2023-08-09T14:16:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.508+0000 7f9a10e06700 1 -- 172.21.15.5:0/4158087205 wait complete. 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.510+0000 7f9a10e06700 1 Processor -- start 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.510+0000 7f9a10e06700 1 -- start start 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c06d930 0x7f9a0c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 0x7f9a0c0af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c7090 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0ad5a0 con 0x7f9a0c15b130 2023-08-09T14:16:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0ad880 con 0x7f9a0c06d930 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43740/0 (socket says 172.21.15.5:43740) 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 -- 172.21.15.5:0/2489760381 learned_addr learned my addr 172.21.15.5:0/2489760381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a0a59c700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c06d930 0x7f9a0c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a0ad9d700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 0x7f9a0c0af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 -- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c06d930 msgr2=0x7f9a0c14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c06d930 0x7f9a0c14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 -- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 msgr2=0x7f9a0c0af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 0x7f9a0c0af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 -- 172.21.15.5:0/2489760381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009550 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a0ad9d700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 0x7f9a0c0af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a09d9b700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000c00 tx=0x7f99f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4004480 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f401f070 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0adb60 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40038c0 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.511+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0ad290 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.512+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c06a740 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.513+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f99f4021030 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.513+0000 7f9a02ffd700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 0x7f99ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.513+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99f4089b90 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.513+0000 7f9a0a59c700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 0x7f99ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.514+0000 7f9a0a59c700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 0x7f99ec06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009930 tx=0x7f99fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.518+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9a0c06a740 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.716+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a0c06a710 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.716+0000 7f9a02ffd700 1 -- 172.21.15.5:0/2489760381 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99f40150a0 con 0x7f9a0c0ca3f0 2023-08-09T14:16:01.719 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 msgr2=0x7f99ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 0x7f99ec06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009930 tx=0x7f99fc008040 comp rx=0 tx=0).stop 2023-08-09T14:16:01.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 msgr2=0x7f9a0c0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000c00 tx=0x7f99f4004750 comp rx=0 tx=0).stop 2023-08-09T14:16:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 shutdown_connections 2023-08-09T14:16:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f99ec06a0e0 0x7f99ec06c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9a0c15b130 0x7f9a0c0af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9a0c06d930 0x7f9a0c14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.718+0000 7f9a10e06700 1 --2- 172.21.15.5:0/2489760381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a0c0ca3f0 0x7f9a0c0aeb60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.719+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 >> 172.21.15.5:0/2489760381 conn(0x7f9a0c0b1970 msgr2=0x7f9a0c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.719+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 shutdown_connections 2023-08-09T14:16:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.719+0000 7f9a10e06700 1 -- 172.21.15.5:0/2489760381 wait complete. 2023-08-09T14:16:01.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T14:16:01.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.860+0000 7f3612182700 1 Processor -- start 2023-08-09T14:16:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.860+0000 7f3612182700 1 -- start start 2023-08-09T14:16:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.861+0000 7f3612182700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f360c1599d0 0x7f360c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.861+0000 7f3612182700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c159ef0 con 0x7f360c06ccf0 2023-08-09T14:16:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.861+0000 7f3612182700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c15a160 con 0x7f360c0c9d00 2023-08-09T14:16:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.861+0000 7f3612182700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c15a440 con 0x7f360c1599d0 2023-08-09T14:16:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f360c06ccf0 0x7f360c0cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57166/0 (socket says 172.21.15.5:57166) 2023-08-09T14:16:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360bfff700 1 -- 172.21.15.5:0/2268979108 learned_addr learned my addr 172.21.15.5:0/2268979108 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360b7fe700 1 --2- 172.21.15.5:0/2268979108 >> v2:172.21.15.101:3300/0 conn(0x7f360c1599d0 0x7f360c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100106294 0 0) 0x7f360c159ef0 con 0x7f360c06ccf0 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f80035b0 con 0x7f360c06ccf0 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206924753 0 0) 0x7f35f80035b0 con 0x7f360c06ccf0 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 >> v2:172.21.15.101:3300/0 conn(0x7f360c1599d0 msgr2=0x7f360c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 --2- 172.21.15.5:0/2268979108 >> v2:172.21.15.101:3300/0 conn(0x7f360c1599d0 0x7f360c0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 >> v1:172.21.15.101:6789/0 conn(0x7f360c0c9d00 legacy=0x7f360c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c15a720 con 0x7f360c06ccf0 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f36040019f0 con 0x7f360c06ccf0 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 >> v1:172.21.15.5:6789/0 conn(0x7f360c06ccf0 legacy=0x7f360c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35f8003a00 0x7f35f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f35f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35f8005210 0x7f35f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c15a440 con 0x7f35f8004850 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f800c0b0 con 0x7f35f8005210 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f800c270 con 0x7f35f8003a00 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360affd700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f35f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.862+0000 7f360bfff700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35f8005210 0x7f35f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360b7fe700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35f8003a00 0x7f35f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 -- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35f8003a00 msgr2=0x7f35f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f35f8003a00 0x7f35f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 -- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35f8005210 msgr2=0x7f35f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f35f8005210 0x7f35f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 -- 172.21.15.5:0/2268979108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80035b0 con 0x7f35f8004850 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360bfff700 1 -- 172.21.15.5:0/2268979108 reap_dead start 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360affd700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f35f8004cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35f40017c0 tx=0x7f35f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9794ae4fe62fba27 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f40052d0 con 0x7f35f8004850 2023-08-09T14:16:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4005450 con 0x7f35f8004850 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f360a7fc700 1 -- 172.21.15.5:0/2268979108 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f40038c0 con 0x7f35f8004850 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f3612182700 1 -- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 msgr2=0x7f35f8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.863+0000 7f3612182700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f35f8004cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35f40017c0 tx=0x7f35f8005880 comp rx=0 tx=0).stop 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.864+0000 7f3612182700 1 -- 172.21.15.5:0/2268979108 shutdown_connections 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.864+0000 7f3612182700 1 --2- 172.21.15.5:0/2268979108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f35f8004cd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.864+0000 7f3612182700 1 -- 172.21.15.5:0/2268979108 >> 172.21.15.5:0/2268979108 conn(0x7f360c0cecb0 msgr2=0x7f360c0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.864+0000 7f3612182700 1 -- 172.21.15.5:0/2268979108 shutdown_connections 2023-08-09T14:16:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.864+0000 7f3612182700 1 -- 172.21.15.5:0/2268979108 wait complete. 2023-08-09T14:16:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.865+0000 7f3612182700 1 Processor -- start 2023-08-09T14:16:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.865+0000 7f3612182700 1 -- start start 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 0x7f360c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 0x7f360c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0c33c0 con 0x7f35f8004850 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0c4e20 con 0x7f360c15c330 2023-08-09T14:16:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3612182700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0c5100 con 0x7f360c0c6c90 2023-08-09T14:16:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43758/0 (socket says 172.21.15.5:43758) 2023-08-09T14:16:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 -- 172.21.15.5:0/828321570 learned_addr learned my addr 172.21.15.5:0/828321570 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 -- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 msgr2=0x7f360c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360affd700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 0x7f360c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360bfff700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 0x7f360c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 0x7f360c15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 -- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 msgr2=0x7f360c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 0x7f360c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 -- 172.21.15.5:0/828321570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0c53e0 con 0x7f35f8004850 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360affd700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 0x7f360c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360bfff700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 0x7f360c15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f360b7fe700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0119a0 tx=0x7f35fc011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00f940 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc00faa0 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.866+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00fe30 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.867+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c0b0410 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.867+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0c72f0 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.868+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c0c36a0 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.868+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35fc01d400 con 0x7f35f8004850 2023-08-09T14:16:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.869+0000 7f3603fff700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 0x7f35ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.869+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35fc0890d0 con 0x7f35f8004850 2023-08-09T14:16:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.869+0000 7f360affd700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 0x7f35ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.870+0000 7f360affd700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 0x7f35ec06c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f360c15c2e0 tx=0x7f35f4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:01.873+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f35fc0549e0 con 0x7f35f8004850 2023-08-09T14:16:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.074+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f360c0cac40 con 0x7f35f8004850 2023-08-09T14:16:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.080+0000 7f3603fff700 1 -- 172.21.15.5:0/828321570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35fc058000 con 0x7f35f8004850 2023-08-09T14:16:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 msgr2=0x7f35ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 0x7f35ec06c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f360c15c2e0 tx=0x7f35f4009030 comp rx=0 tx=0).stop 2023-08-09T14:16:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 msgr2=0x7f360c1544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0119a0 tx=0x7f35fc011d60 comp rx=0 tx=0).stop 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 shutdown_connections 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f35ec06a0e0 0x7f35ec06c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f360c0c6c90 0x7f360c15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f8004850 0x7f360c1544c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 --2- 172.21.15.5:0/828321570 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f360c15c330 0x7f360c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 >> 172.21.15.5:0/828321570 conn(0x7f360c0cecb0 msgr2=0x7f360c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 shutdown_connections 2023-08-09T14:16:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.082+0000 7f3612182700 1 -- 172.21.15.5:0/828321570 wait complete. 2023-08-09T14:16:02.095 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T14:16:02.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T14:16:02.137 DEBUG:teuthology.orchestra.run.smithi101:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T14:16:02.183 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T14:16:02.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:02.184 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:02.201 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:02.202 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:02.259 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:02.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:02.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:02.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.480+0000 7f902cec3700 1 Processor -- start 2023-08-09T14:16:02.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.480+0000 7f902cec3700 1 -- start start 2023-08-09T14:16:02.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f902cec3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f902806a640 0x7f90280cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f902cec3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280ce050 con 0x7f902806a1c0 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f902cec3700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902806e850 con 0x7f902815d400 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f902cec3700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902806aad0 con 0x7f902806a640 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f9025d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f902806a1c0 0x7f90280cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57184/0 (socket says 172.21.15.5:57184) 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f9025d9b700 1 -- 172.21.15.5:0/2686246962 learned_addr learned my addr 172.21.15.5:0/2686246962 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.481+0000 7f9026d9d700 1 --2- 172.21.15.5:0/2686246962 >> v2:172.21.15.101:3300/0 conn(0x7f902806a640 0x7f90280cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018860098 0 0) 0x7f90280ce050 con 0x7f902806a1c0 2023-08-09T14:16:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90140035b0 con 0x7f902806a1c0 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355245294 0 0) 0x7f902806e850 con 0x7f902815d400 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90280ce050 con 0x7f902815d400 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126208414 0 0) 0x7f90140035b0 con 0x7f902806a1c0 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 >> v2:172.21.15.101:3300/0 conn(0x7f902806a640 msgr2=0x7f90280cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 --2- 172.21.15.5:0/2686246962 >> v2:172.21.15.101:3300/0 conn(0x7f902806a640 0x7f90280cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 >> v1:172.21.15.101:6789/0 conn(0x7f902815d400 legacy=0x7f90280cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280cf7b0 con 0x7f902806a1c0 2023-08-09T14:16:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f9010001670 con 0x7f902806a1c0 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 >> v1:172.21.15.5:6789/0 conn(0x7f902806a1c0 legacy=0x7f90280cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014003b90 0x7f9014003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9014004850 0x7f9014004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 0x7f901400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902806aad0 con 0x7f9014005210 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901400c090 con 0x7f9014003b90 2023-08-09T14:16:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901400c250 con 0x7f9014004850 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 0x7f901400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f902659c700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014003b90 0x7f9014003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9025d9b700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9014004850 0x7f9014004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 -- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9014004850 msgr2=0x7f9014004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9014004850 0x7f9014004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 -- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014003b90 msgr2=0x7f9014003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014003b90 0x7f9014003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.482+0000 7f9026d9d700 1 -- 172.21.15.5:0/2686246962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140035b0 con 0x7f9014005210 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f9026d9d700 1 -- 172.21.15.5:0/2686246962 reap_dead start 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f9026d9d700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 0x7f901400ba10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9020009b60 tx=0x7f9014005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5440d181861c7a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020004020 con 0x7f9014005210 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020004180 con 0x7f9014005210 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902559a700 1 -- 172.21.15.5:0/2686246962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020004530 con 0x7f9014005210 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 -- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 msgr2=0x7f901400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 0x7f901400ba10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9020009b60 tx=0x7f9014005880 comp rx=0 tx=0).stop 2023-08-09T14:16:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 -- 172.21.15.5:0/2686246962 shutdown_connections 2023-08-09T14:16:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 --2- 172.21.15.5:0/2686246962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014005210 0x7f901400ba10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 -- 172.21.15.5:0/2686246962 >> 172.21.15.5:0/2686246962 conn(0x7f90280b1900 msgr2=0x7f90280b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 -- 172.21.15.5:0/2686246962 shutdown_connections 2023-08-09T14:16:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.483+0000 7f902cec3700 1 -- 172.21.15.5:0/2686246962 wait complete. 2023-08-09T14:16:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.485+0000 7f902cec3700 1 Processor -- start 2023-08-09T14:16:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.485+0000 7f902cec3700 1 -- start start 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014005210 0x7f9028158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f902815fc30 0x7f90281600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9028160620 con 0x7f9028159880 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281587e0 con 0x7f9014005210 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902cec3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9028158ac0 con 0x7f902815fc30 2023-08-09T14:16:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f9025d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f9025d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43780/0 (socket says 172.21.15.5:43780) 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f9025d9b700 1 -- 172.21.15.5:0/1621283348 learned_addr learned my addr 172.21.15.5:0/1621283348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f902659c700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014005210 0x7f9028158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.486+0000 7f9026d9d700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f902815fc30 0x7f90281600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 -- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f902815fc30 msgr2=0x7f90281600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f902815fc30 0x7f90281600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 -- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014005210 msgr2=0x7f9028158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014005210 0x7f9028158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 -- 172.21.15.5:0/1621283348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028158da0 con 0x7f9028159880 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f9025d9b700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9010007340 tx=0x7f9010007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901000f660 con 0x7f9028159880 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901000f800 con 0x7f9028159880 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9028159080 con 0x7f9028159880 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901000fbb0 con 0x7f9028159880 2023-08-09T14:16:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.487+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9028146530 con 0x7f9028159880 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.488+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90281595a0 con 0x7f9028159880 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.488+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f901000fd10 con 0x7f9028159880 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.489+0000 7f901effd700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 0x7f900806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.489+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9010088320 con 0x7f9028159880 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.489+0000 7f902659c700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 0x7f900806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.489+0000 7f902659c700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 0x7f900806c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9018000f80 tx=0x7f9018009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.493+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f90281595a0 con 0x7f9028159880 2023-08-09T14:16:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.694+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90281595a0 con 0x7f9028159880 2023-08-09T14:16:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.695+0000 7f901effd700 1 -- 172.21.15.5:0/1621283348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f90281595a0 con 0x7f9028159880 2023-08-09T14:16:02.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:02.697 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 msgr2=0x7f900806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 0x7f900806c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9018000f80 tx=0x7f9018009040 comp rx=0 tx=0).stop 2023-08-09T14:16:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 msgr2=0x7f9028145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9010007340 tx=0x7f9010007650 comp rx=0 tx=0).stop 2023-08-09T14:16:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 shutdown_connections 2023-08-09T14:16:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f900806a0e0 0x7f900806c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f902815fc30 0x7f90281600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9014005210 0x7f9028158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 --2- 172.21.15.5:0/1621283348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028159880 0x7f9028145ff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 >> 172.21.15.5:0/1621283348 conn(0x7f90280b1900 msgr2=0x7f902815abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:02.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 shutdown_connections 2023-08-09T14:16:02.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.697+0000 7f902cec3700 1 -- 172.21.15.5:0/1621283348 wait complete. 2023-08-09T14:16:02.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:02.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.838+0000 7fc76f26b700 1 Processor -- start 2023-08-09T14:16:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.838+0000 7fc76f26b700 1 -- start start 2023-08-09T14:16:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76f26b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc76815d3a0 0x7fc7680af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76f26b700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fc7680cd1c0 0x7fc7680cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76f26b700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680715a0 con 0x7fc76806a1c0 2023-08-09T14:16:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76f26b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680cd6c0 con 0x7fc76815d3a0 2023-08-09T14:16:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76f26b700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680712a0 con 0x7fc7680cd1c0 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc76815d3a0 0x7fc7680af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc76815d3a0 0x7fc7680af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43786/0 (socket says 172.21.15.5:43786) 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 -- 172.21.15.5:0/3220843472 learned_addr learned my addr 172.21.15.5:0/3220843472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76c806700 1 --2- 172.21.15.5:0/3220843472 >> v2:172.21.15.101:3300/0 conn(0x7fc7680cd1c0 0x7fc7680cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 -- 172.21.15.5:0/3220843472 >> v2:172.21.15.101:3300/0 conn(0x7fc7680cd1c0 msgr2=0x7fc7680cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 --2- 172.21.15.5:0/3220843472 >> v2:172.21.15.101:3300/0 conn(0x7fc7680cd1c0 0x7fc7680cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 -- 172.21.15.5:0/3220843472 >> v1:172.21.15.101:6789/0 conn(0x7fc76806a1c0 legacy=0x7fc768160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.839+0000 7fc76d007700 1 -- 172.21.15.5:0/3220843472 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680cf570 con 0x7fc76815d3a0 2023-08-09T14:16:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76d007700 1 --2- 172.21.15.5:0/3220843472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc76815d3a0 0x7fc7680af2c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc768071510 tx=0x7fc758009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc4bf16feaa6dff server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc75ffff700 1 -- 172.21.15.5:0/3220843472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800b870 con 0x7fc76815d3a0 2023-08-09T14:16:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc75ffff700 1 -- 172.21.15.5:0/3220843472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800b9d0 con 0x7fc76815d3a0 2023-08-09T14:16:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc75ffff700 1 -- 172.21.15.5:0/3220843472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800bd60 con 0x7fc76815d3a0 2023-08-09T14:16:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 -- 172.21.15.5:0/3220843472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc76815d3a0 msgr2=0x7fc7680af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 --2- 172.21.15.5:0/3220843472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc76815d3a0 0x7fc7680af2c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc768071510 tx=0x7fc758009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 -- 172.21.15.5:0/3220843472 shutdown_connections 2023-08-09T14:16:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 --2- 172.21.15.5:0/3220843472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc76815d3a0 0x7fc7680af2c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 --2- 172.21.15.5:0/3220843472 >> v2:172.21.15.101:3300/0 conn(0x7fc7680cd1c0 0x7fc7680cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 -- 172.21.15.5:0/3220843472 >> 172.21.15.5:0/3220843472 conn(0x7fc7680b1970 msgr2=0x7fc7680b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.840+0000 7fc76f26b700 1 -- 172.21.15.5:0/3220843472 shutdown_connections 2023-08-09T14:16:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.841+0000 7fc76f26b700 1 -- 172.21.15.5:0/3220843472 wait complete. 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.842+0000 7fc76f26b700 1 Processor -- start 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.842+0000 7fc76f26b700 1 -- start start 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.842+0000 7fc76f26b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fc76806a1c0 0x7fc7681576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.842+0000 7fc76f26b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.842+0000 7fc76f26b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fc76815d3a0 0x7fc7681590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76f26b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680c41e0 con 0x7fc7680cd1c0 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76f26b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680c38d0 con 0x7fc76815d3a0 2023-08-09T14:16:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76f26b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681606a0 con 0x7fc76806a1c0 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43792/0 (socket says 172.21.15.5:43792) 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 -- 172.21.15.5:0/2837368275 learned_addr learned my addr 172.21.15.5:0/2837368275 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76d007700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fc76806a1c0 0x7fc7681576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76d808700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fc76815d3a0 0x7fc7681590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 -- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fc76806a1c0 msgr2=0x7fc7681576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fc76806a1c0 0x7fc7681576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 -- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fc76815d3a0 msgr2=0x7fc7681590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fc76815d3a0 0x7fc7681590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 -- 172.21.15.5:0/2837368275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009550 con 0x7fc7680cd1c0 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76c806700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e810 tx=0x7fc76400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400c070 con 0x7fc7680cd1c0 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764013610 con 0x7fc7680cd1c0 2023-08-09T14:16:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7680c3b20 con 0x7fc7680cd1c0 2023-08-09T14:16:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.843+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640139a0 con 0x7fc7680cd1c0 2023-08-09T14:16:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.844+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc768157c10 con 0x7fc7680cd1c0 2023-08-09T14:16:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.844+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc768074600 con 0x7fc7680cd1c0 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.845+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc764013b00 con 0x7fc7680cd1c0 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.845+0000 7fc75dffb700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 0x7fc74c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.845+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc764087f00 con 0x7fc7680cd1c0 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.845+0000 7fc76d007700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 0x7fc74c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.846+0000 7fc76d007700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 0x7fc74c06c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc758014040 tx=0x7fc758008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:02.850+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc764057110 con 0x7fc7680cd1c0 2023-08-09T14:16:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.049+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7680b27c0 con 0x7fc7680cd1c0 2023-08-09T14:16:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.049+0000 7fc75dffb700 1 -- 172.21.15.5:0/2837368275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc764013db0 con 0x7fc7680cd1c0 2023-08-09T14:16:03.051 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 msgr2=0x7fc74c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 0x7fc74c06c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc758014040 tx=0x7fc758008030 comp rx=0 tx=0).stop 2023-08-09T14:16:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 msgr2=0x7fc76815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e810 tx=0x7fc76400eb20 comp rx=0 tx=0).stop 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 shutdown_connections 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fc74c06a0e0 0x7fc74c06c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fc76815d3a0 0x7fc7681590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fc76806a1c0 0x7fc7681576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 --2- 172.21.15.5:0/2837368275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7680cd1c0 0x7fc76815fda0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.051+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 >> 172.21.15.5:0/2837368275 conn(0x7fc7680b1970 msgr2=0x7fc7680ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.052+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 shutdown_connections 2023-08-09T14:16:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.052+0000 7fc76f26b700 1 -- 172.21.15.5:0/2837368275 wait complete. 2023-08-09T14:16:03.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:03.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.192+0000 7f3beff4b700 1 Processor -- start 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.192+0000 7f3beff4b700 1 -- start start 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3beff4b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3be80b2c70 0x7f3be80cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3beff4b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80cb2d0 con 0x7f3be80ce410 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3beff4b700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80cb5b0 con 0x7f3be8159e90 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3beff4b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80cb890 con 0x7f3be80b2c70 2023-08-09T14:16:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3bed4e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3be80b2c70 0x7f3be80cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3bee4e8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3be80ce410 0x7f3be80cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57218/0 (socket says 172.21.15.5:57218) 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3bed4e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3be80b2c70 0x7f3be80cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43800/0 (socket says 172.21.15.5:43800) 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.193+0000 7f3bee4e8700 1 -- 172.21.15.5:0/2823835941 learned_addr learned my addr 172.21.15.5:0/2823835941 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3bed4e6700 1 -- 172.21.15.5:0/2823835941 >> v1:172.21.15.101:6789/0 conn(0x7f3be8159e90 legacy=0x7f3be806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3bed4e6700 1 -- 172.21.15.5:0/2823835941 >> v1:172.21.15.5:6789/0 conn(0x7f3be80ce410 legacy=0x7f3be80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3bed4e6700 1 -- 172.21.15.5:0/2823835941 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80cbb70 con 0x7f3be80b2c70 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3bed4e6700 1 --2- 172.21.15.5:0/2823835941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80b2c70 0x7f3be80cacd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009840 tx=0x7f3bd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f85962878b084f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3becce5700 1 -- 172.21.15.5:0/2823835941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8011830 con 0x7f3be80b2c70 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3becce5700 1 -- 172.21.15.5:0/2823835941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd8011990 con 0x7f3be80b2c70 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3becce5700 1 -- 172.21.15.5:0/2823835941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8011d20 con 0x7f3be80b2c70 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3beff4b700 1 -- 172.21.15.5:0/2823835941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80b2c70 msgr2=0x7f3be80cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.194+0000 7f3beff4b700 1 --2- 172.21.15.5:0/2823835941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80b2c70 0x7f3be80cacd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009840 tx=0x7f3bd8009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.195+0000 7f3beff4b700 1 -- 172.21.15.5:0/2823835941 shutdown_connections 2023-08-09T14:16:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.195+0000 7f3beff4b700 1 --2- 172.21.15.5:0/2823835941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80b2c70 0x7f3be80cacd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.195+0000 7f3beff4b700 1 -- 172.21.15.5:0/2823835941 >> 172.21.15.5:0/2823835941 conn(0x7f3be80b1970 msgr2=0x7f3be80b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.195+0000 7f3beff4b700 1 -- 172.21.15.5:0/2823835941 shutdown_connections 2023-08-09T14:16:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.195+0000 7f3beff4b700 1 -- 172.21.15.5:0/2823835941 wait complete. 2023-08-09T14:16:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.196+0000 7f3beff4b700 1 Processor -- start 2023-08-09T14:16:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.196+0000 7f3beff4b700 1 -- start start 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3be80b2c70 0x7f3be8158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 0x7f3be80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80a9590 con 0x7f3be80ce410 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8158850 con 0x7f3be8159e90 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80a92b0 con 0x7f3be80b2c70 2023-08-09T14:16:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43806/0 (socket says 172.21.15.5:43806) 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 -- 172.21.15.5:0/3776143563 learned_addr learned my addr 172.21.15.5:0/3776143563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bee4e8700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 0x7f3be80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bedce7700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3be80b2c70 0x7f3be8158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 -- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3be80b2c70 msgr2=0x7f3be8158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3be80b2c70 0x7f3be8158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 -- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 msgr2=0x7f3be80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 0x7f3be80b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 -- 172.21.15.5:0/3776143563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80094a0 con 0x7f3be80ce410 2023-08-09T14:16:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bee4e8700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 0x7f3be80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bed4e6700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80090b0 tx=0x7f3bd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80038a0 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd801f070 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be80b34d0 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8003c60 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.197+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be80b3a90 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.198+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80b3330 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.199+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3bd801a430 con 0x7f3be80ce410 2023-08-09T14:16:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.199+0000 7f3bde7fc700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 0x7f3bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.199+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bd8021070 con 0x7f3be80ce410 2023-08-09T14:16:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.199+0000 7f3bedce7700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 0x7f3bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.200+0000 7f3bedce7700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 0x7f3bcc06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000f60 tx=0x7f3be4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.204+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3be80b3330 con 0x7f3be80ce410 2023-08-09T14:16:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.402+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3be80b3330 con 0x7f3be80ce410 2023-08-09T14:16:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.403+0000 7f3bde7fc700 1 -- 172.21.15.5:0/3776143563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3be80b3330 con 0x7f3be80ce410 2023-08-09T14:16:03.404 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 msgr2=0x7f3bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 0x7f3bcc06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000f60 tx=0x7f3be4009040 comp rx=0 tx=0).stop 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 msgr2=0x7f3be80ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80090b0 tx=0x7f3bd8004750 comp rx=0 tx=0).stop 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 shutdown_connections 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bcc06a0e0 0x7f3bcc06c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3be8159e90 0x7f3be80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3be80b2c70 0x7f3be8158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 --2- 172.21.15.5:0/3776143563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be80ce410 0x7f3be80ac590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 >> 172.21.15.5:0/3776143563 conn(0x7f3be80b1970 msgr2=0x7f3be80c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 shutdown_connections 2023-08-09T14:16:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.405+0000 7f3beff4b700 1 -- 172.21.15.5:0/3776143563 wait complete. 2023-08-09T14:16:03.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.545+0000 7fae24331700 1 Processor -- start 2023-08-09T14:16:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.545+0000 7fae24331700 1 -- start start 2023-08-09T14:16:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae24331700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fae1c0cc460 0x7fae1c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae24331700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0b4180 con 0x7fae1c15b280 2023-08-09T14:16:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae24331700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0b53f0 con 0x7fae1c15b660 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae24331700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c066300 con 0x7fae1c0cc460 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae220cd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae1c15b280 0x7fae1c0cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57228/0 (socket says 172.21.15.5:57228) 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae220cd700 1 -- 172.21.15.5:0/694864977 learned_addr learned my addr 172.21.15.5:0/694864977 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae218cc700 1 --2- 172.21.15.5:0/694864977 >> v2:172.21.15.101:3300/0 conn(0x7fae1c0cc460 0x7fae1c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697286362 0 0) 0x7fae1c0b4180 con 0x7fae1c15b280 2023-08-09T14:16:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae080035b0 con 0x7fae1c15b280 2023-08-09T14:16:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795884984 0 0) 0x7fae080035b0 con 0x7fae1c15b280 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 >> v2:172.21.15.101:3300/0 conn(0x7fae1c0cc460 msgr2=0x7fae1c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 --2- 172.21.15.5:0/694864977 >> v2:172.21.15.101:3300/0 conn(0x7fae1c0cc460 0x7fae1c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 >> v1:172.21.15.101:6789/0 conn(0x7fae1c15b660 legacy=0x7fae1c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0b43d0 con 0x7fae1c15b280 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.546+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fae0c0017f0 con 0x7fae1c15b280 2023-08-09T14:16:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 >> v1:172.21.15.5:6789/0 conn(0x7fae1c15b280 legacy=0x7fae1c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08003a00 0x7fae08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 0x7fae08004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae08005210 0x7fae0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c066300 con 0x7fae08004850 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0800c1b0 con 0x7fae08005210 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0800c370 con 0x7fae08003a00 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 0x7fae08004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae220cd700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08003a00 0x7fae08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae228ce700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae08005210 0x7fae0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 -- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08003a00 msgr2=0x7fae08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08003a00 0x7fae08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 -- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae08005210 msgr2=0x7fae0800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae08005210 0x7fae0800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 -- 172.21.15.5:0/694864977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080035b0 con 0x7fae08004850 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae228ce700 1 -- 172.21.15.5:0/694864977 reap_dead start 2023-08-09T14:16:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae218cc700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 0x7fae08004cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae18009b60 tx=0x7fae08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e5b6b66ee6873d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800e6c0 con 0x7fae08004850 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800e820 con 0x7fae08004850 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.547+0000 7fae210cb700 1 -- 172.21.15.5:0/694864977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800eb90 con 0x7fae08004850 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 -- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 msgr2=0x7fae08004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 0x7fae08004cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae18009b60 tx=0x7fae08005880 comp rx=0 tx=0).stop 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 -- 172.21.15.5:0/694864977 shutdown_connections 2023-08-09T14:16:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 --2- 172.21.15.5:0/694864977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae08004850 0x7fae08004cd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 -- 172.21.15.5:0/694864977 >> 172.21.15.5:0/694864977 conn(0x7fae1c0cf4d0 msgr2=0x7fae1c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 -- 172.21.15.5:0/694864977 shutdown_connections 2023-08-09T14:16:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.548+0000 7fae24331700 1 -- 172.21.15.5:0/694864977 wait complete. 2023-08-09T14:16:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.549+0000 7fae24331700 1 Processor -- start 2023-08-09T14:16:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.549+0000 7fae24331700 1 -- start start 2023-08-09T14:16:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08004850 0x7fae1c0981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae1c155550 0x7fae1c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b0e50 con 0x7fae1c1559d0 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c098720 con 0x7fae1c155550 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae24331700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c098a30 con 0x7fae08004850 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43828/0 (socket says 172.21.15.5:43828) 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 -- 172.21.15.5:0/59445473 learned_addr learned my addr 172.21.15.5:0/59445473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae220cd700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08004850 0x7fae1c0981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae218cc700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae1c155550 0x7fae1c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 -- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08004850 msgr2=0x7fae1c0981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08004850 0x7fae1c0981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 -- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae1c155550 msgr2=0x7fae1c0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae1c155550 0x7fae1c0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.550+0000 7fae228ce700 1 -- 172.21.15.5:0/59445473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c150db0 con 0x7fae1c1559d0 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae228ce700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae1c071450 tx=0x7fae1400ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14003cd0 con 0x7fae1c1559d0 2023-08-09T14:16:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14003e70 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140052f0 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c151090 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.551+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c15e0f0 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.552+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c0b0fa0 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.552+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae14005450 con 0x7fae1c1559d0 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.552+0000 7fae12ffd700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 0x7fae0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.553+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae14088560 con 0x7fae1c1559d0 2023-08-09T14:16:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.553+0000 7fae220cd700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 0x7fae0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.553+0000 7fae220cd700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 0x7fae0006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000ef0 tx=0x7fae0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.557+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fae1c0b0fa0 con 0x7fae1c1559d0 2023-08-09T14:16:03.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:16:03.569 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:16:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.758+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae1c0b0fa0 con 0x7fae1c1559d0 2023-08-09T14:16:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.758+0000 7fae12ffd700 1 -- 172.21.15.5:0/59445473 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae1c0b0fa0 con 0x7fae1c1559d0 2023-08-09T14:16:03.760 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 msgr2=0x7fae0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 0x7fae0006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000ef0 tx=0x7fae0c009040 comp rx=0 tx=0).stop 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 msgr2=0x7fae1c0b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae1c071450 tx=0x7fae1400ff00 comp rx=0 tx=0).stop 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 shutdown_connections 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fae0006a0e0 0x7fae0006c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1c1559d0 0x7fae1c0b17c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fae08004850 0x7fae1c0981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 --2- 172.21.15.5:0/59445473 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fae1c155550 0x7fae1c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 >> 172.21.15.5:0/59445473 conn(0x7fae1c0cf4d0 msgr2=0x7fae1c0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 shutdown_connections 2023-08-09T14:16:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.761+0000 7fae24331700 1 -- 172.21.15.5:0/59445473 wait complete. 2023-08-09T14:16:03.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:03.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.900+0000 7fe2e7af4700 1 Processor -- start 2023-08-09T14:16:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.900+0000 7fe2e7af4700 1 -- start start 2023-08-09T14:16:03.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.901+0000 7fe2e7af4700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe2e015d3a0 0x7fe2e00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.901+0000 7fe2e7af4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.901+0000 7fe2e7af4700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e00715a0 con 0x7fe2e006a1c0 2023-08-09T14:16:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.901+0000 7fe2e7af4700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e00cd6c0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.901+0000 7fe2e7af4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00712a0 con 0x7fe2e00cd1c0 2023-08-09T14:16:03.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe2e015d3a0 0x7fe2e00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e508f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e6091700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7fe2e006a1c0 0x7fe2e0160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38598/0 (socket says 172.21.15.5:38598) 2023-08-09T14:16:03.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fe2e015d3a0 0x7fe2e00af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:60876/0 (socket says 172.21.15.5:60876) 2023-08-09T14:16:03.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e6091700 1 -- 172.21.15.5:0/2245236386 learned_addr learned my addr 172.21.15.5:0/2245236386 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:03.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e508f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:33414/0 (socket says 172.21.15.5:33414) 2023-08-09T14:16:03.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 -- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 msgr2=0x7fe2e00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:03.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 -- 172.21.15.5:0/2245236386 >> v1:172.21.15.101:6789/0 conn(0x7fe2e006a1c0 legacy=0x7fe2e0160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 -- 172.21.15.5:0/2245236386 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00cf570 con 0x7fe2e015d3a0 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e488e700 1 -- 172.21.15.5:0/2245236386 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413361193 0 0) 0x7fe2e00715a0 con 0x7fe2e006a1c0 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e508f700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e5890700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00af2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009840 tx=0x7fe2d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ee55090e68d6bb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e488e700 1 -- 172.21.15.5:0/2245236386 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011830 con 0x7fe2e015d3a0 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e488e700 1 -- 172.21.15.5:0/2245236386 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0011990 con 0x7fe2e015d3a0 2023-08-09T14:16:03.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.902+0000 7fe2e488e700 1 -- 172.21.15.5:0/2245236386 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011d20 con 0x7fe2e015d3a0 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e015d3a0 msgr2=0x7fe2e00af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00af2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009840 tx=0x7fe2d0009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2245236386 shutdown_connections 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00af2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2245236386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2245236386 >> 172.21.15.5:0/2245236386 conn(0x7fe2e00b1970 msgr2=0x7fe2e00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2245236386 shutdown_connections 2023-08-09T14:16:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.903+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2245236386 wait complete. 2023-08-09T14:16:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.904+0000 7fe2e7af4700 1 Processor -- start 2023-08-09T14:16:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.904+0000 7fe2e7af4700 1 -- start start 2023-08-09T14:16:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e006a1c0 0x7fe2e01f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c41b0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c4490 con 0x7fe2e006a1c0 2023-08-09T14:16:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e7af4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c4770 con 0x7fe2e00cd1c0 2023-08-09T14:16:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43842/0 (socket says 172.21.15.5:43842) 2023-08-09T14:16:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 -- 172.21.15.5:0/2379843748 learned_addr learned my addr 172.21.15.5:0/2379843748 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e5890700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e006a1c0 0x7fe2e01f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e508f700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 -- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 msgr2=0x7fe2e00c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 -- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e006a1c0 msgr2=0x7fe2e01f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e006a1c0 0x7fe2e01f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.905+0000 7fe2e6091700 1 -- 172.21.15.5:0/2379843748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0094a0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2e6091700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800cca0 tx=0x7fe2d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800ab70 con 0x7fe2e015d3a0 2023-08-09T14:16:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800acd0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d00094a0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8007310 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.906+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e00c4d30 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.907+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e00c4f50 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.907+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2d8007470 con 0x7fe2e015d3a0 2023-08-09T14:16:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.908+0000 7fe2d67fc700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 0x7fe2c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.908+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2d80881d0 con 0x7fe2e015d3a0 2023-08-09T14:16:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.908+0000 7fe2e5890700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 0x7fe2c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.908+0000 7fe2e5890700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 0x7fe2c406c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0000c00 tx=0x7fe2d001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:03.912+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe2d80537a0 con 0x7fe2e015d3a0 2023-08-09T14:16:04.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.109+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2e00cfac0 con 0x7fe2e015d3a0 2023-08-09T14:16:04.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.109+0000 7fe2d67fc700 1 -- 172.21.15.5:0/2379843748 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2d8056dc0 con 0x7fe2e015d3a0 2023-08-09T14:16:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.111+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 msgr2=0x7fe2c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.111+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 0x7fe2c406c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0000c00 tx=0x7fe2d001c040 comp rx=0 tx=0).stop 2023-08-09T14:16:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.111+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 msgr2=0x7fe2e00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.111+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800cca0 tx=0x7fe2d800a060 comp rx=0 tx=0).stop 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 shutdown_connections 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe2c406a0e0 0x7fe2c406c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2e015d3a0 0x7fe2e00adc60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe2e006a1c0 0x7fe2e01f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 --2- 172.21.15.5:0/2379843748 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe2e00cd1c0 0x7fe2e00c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 >> 172.21.15.5:0/2379843748 conn(0x7fe2e00b1970 msgr2=0x7fe2e015b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 shutdown_connections 2023-08-09T14:16:04.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.112+0000 7fe2e7af4700 1 -- 172.21.15.5:0/2379843748 wait complete. 2023-08-09T14:16:04.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T14:16:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.250+0000 7f2f4659b700 1 Processor -- start 2023-08-09T14:16:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.250+0000 7f2f4659b700 1 -- start start 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f4659b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f40154600 0x7f2f4015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f4659b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f400ce410 0x7f2f400ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f4659b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f400cee00 con 0x7f2f4015b360 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f4659b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4015eb20 con 0x7f2f40154600 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f4659b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4015e2d0 con 0x7f2f400ce410 2023-08-09T14:16:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f3ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f40154600 0x7f2f4015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f3f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f4015b360 0x7f2f4015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57262/0 (socket says 172.21.15.5:57262) 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f3ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f40154600 0x7f2f4015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43846/0 (socket says 172.21.15.5:43846) 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.251+0000 7f2f3f7fe700 1 -- 172.21.15.5:0/3352543075 learned_addr learned my addr 172.21.15.5:0/3352543075 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f44b38700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f400ce410 0x7f2f400ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3ffff700 1 -- 172.21.15.5:0/3352543075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f400ce410 msgr2=0x7f2f400ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3ffff700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f400ce410 0x7f2f400ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3ffff700 1 -- 172.21.15.5:0/3352543075 >> v1:172.21.15.5:6789/0 conn(0x7f2f4015b360 legacy=0x7f2f4015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3effd700 1 -- 172.21.15.5:0/3352543075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646235853 0 0) 0x7f2f34001110 con 0x7f2f4015b360 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3ffff700 1 -- 172.21.15.5:0/3352543075 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4006d4f0 con 0x7f2f40154600 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3ffff700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f40154600 0x7f2f4015b790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000bae0 tx=0x7f2f3000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18680fb44e1fcc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3effd700 1 -- 172.21.15.5:0/3352543075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000dc70 con 0x7f2f40154600 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3effd700 1 -- 172.21.15.5:0/3352543075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000ddd0 con 0x7f2f40154600 2023-08-09T14:16:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.252+0000 7f2f3effd700 1 -- 172.21.15.5:0/3352543075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30010690 con 0x7f2f40154600 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 -- 172.21.15.5:0/3352543075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f40154600 msgr2=0x7f2f4015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f40154600 0x7f2f4015b790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000bae0 tx=0x7f2f3000bdf0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 -- 172.21.15.5:0/3352543075 shutdown_connections 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f400ce410 0x7f2f400ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 --2- 172.21.15.5:0/3352543075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f40154600 0x7f2f4015b790 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 -- 172.21.15.5:0/3352543075 >> 172.21.15.5:0/3352543075 conn(0x7f2f400b1900 msgr2=0x7f2f400b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 -- 172.21.15.5:0/3352543075 shutdown_connections 2023-08-09T14:16:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.253+0000 7f2f4659b700 1 -- 172.21.15.5:0/3352543075 wait complete. 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.254+0000 7f2f4659b700 1 Processor -- start 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.254+0000 7f2f4659b700 1 -- start start 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f40154600 0x7f2f401581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 0x7f2f400c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4014b460 con 0x7f2f400ce410 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4014c610 con 0x7f2f4015b360 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f4659b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4014c8f0 con 0x7f2f40154600 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43850/0 (socket says 172.21.15.5:43850) 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 -- 172.21.15.5:0/1770536943 learned_addr learned my addr 172.21.15.5:0/1770536943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3f7fe700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f40154600 0x7f2f401581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f44b38700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 0x7f2f400c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 -- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f40154600 msgr2=0x7f2f401581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f40154600 0x7f2f401581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 -- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 msgr2=0x7f2f400c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 0x7f2f400c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 -- 172.21.15.5:0/1770536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3000b740 con 0x7f2f400ce410 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f44b38700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 0x7f2f400c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.255+0000 7f2f3ffff700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b2c0 tx=0x7f2f30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.256+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3001d070 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.256+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3001e040 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.256+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4015a030 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.256+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30010c70 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.256+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f40158710 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.257+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4015a550 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.257+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f300036a0 con 0x7f2f400ce410 2023-08-09T14:16:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.257+0000 7f2f3cff9700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 0x7f2f2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.257+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f3008c7e0 con 0x7f2f400ce410 2023-08-09T14:16:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.258+0000 7f2f3f7fe700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 0x7f2f2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.258+0000 7f2f3f7fe700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 0x7f2f2c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000f60 tx=0x7f2f34007c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.262+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2f30057f60 con 0x7f2f400ce410 2023-08-09T14:16:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.479+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f40074600 con 0x7f2f400ce410 2023-08-09T14:16:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.479+0000 7f2f3cff9700 1 -- 172.21.15.5:0/1770536943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f3005b580 con 0x7f2f400ce410 2023-08-09T14:16:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 msgr2=0x7f2f2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 0x7f2f2c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000f60 tx=0x7f2f34007c90 comp rx=0 tx=0).stop 2023-08-09T14:16:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 msgr2=0x7f2f4014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b2c0 tx=0x7f2f30004750 comp rx=0 tx=0).stop 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 shutdown_connections 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2f2c06a0e0 0x7f2f2c06c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2f4015b360 0x7f2f400c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f400ce410 0x7f2f4014af20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 --2- 172.21.15.5:0/1770536943 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2f40154600 0x7f2f401581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 >> 172.21.15.5:0/1770536943 conn(0x7f2f400b1900 msgr2=0x7f2f4015cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 shutdown_connections 2023-08-09T14:16:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.482+0000 7f2f4659b700 1 -- 172.21.15.5:0/1770536943 wait complete. 2023-08-09T14:16:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-08-09T14:16:04.495 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T14:16:04.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:04.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-09T14:16:04.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:16:04.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:04.548 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T14:16:04.568 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:04.569 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:04.590 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:04.590 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:04.650 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:04.650 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:04.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.833+0000 7ff9bca35700 1 Processor -- start 2023-08-09T14:16:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.833+0000 7ff9bca35700 1 -- start start 2023-08-09T14:16:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7ff9b806a1c0 0x7ff9b806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9b80cc730 0x7ff9b80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b806eb60 con 0x7ff9b80cc730 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b806ab80 con 0x7ff9b806a1c0 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9bca35700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80716b0 con 0x7ff9b815b020 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9b80cc730 0x7ff9b80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9b80cc730 0x7ff9b80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43860/0 (socket says 172.21.15.5:43860) 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 -- 172.21.15.5:0/3606189605 learned_addr learned my addr 172.21.15.5:0/3606189605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b5d9b700 1 --2- 172.21.15.5:0/3606189605 >> v2:172.21.15.101:3300/0 conn(0x7ff9b806a1c0 0x7ff9b806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b659c700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 -- 172.21.15.5:0/3606189605 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 msgr2=0x7ff9b8071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b8071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 -- 172.21.15.5:0/3606189605 >> v2:172.21.15.101:3300/0 conn(0x7ff9b806a1c0 msgr2=0x7ff9b806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 --2- 172.21.15.5:0/3606189605 >> v2:172.21.15.101:3300/0 conn(0x7ff9b806a1c0 0x7ff9b806a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 -- 172.21.15.5:0/3606189605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b806e4c0 con 0x7ff9b80cc730 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b659c700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b8071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.834+0000 7ff9b6d9d700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b80cc730 0x7ff9b80ccbc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80cd880 tx=0x7ff9b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d28eb4cde6a704 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9b559a700 1 -- 172.21.15.5:0/3606189605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000e070 con 0x7ff9b80cc730 2023-08-09T14:16:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9b559a700 1 -- 172.21.15.5:0/3606189605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b000b910 con 0x7ff9b80cc730 2023-08-09T14:16:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9b559a700 1 -- 172.21.15.5:0/3606189605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000bcc0 con 0x7ff9b80cc730 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 -- 172.21.15.5:0/3606189605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b80cc730 msgr2=0x7ff9b80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b80cc730 0x7ff9b80ccbc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80cd880 tx=0x7ff9b000b330 comp rx=0 tx=0).stop 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 -- 172.21.15.5:0/3606189605 shutdown_connections 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b80cc730 0x7ff9b80ccbc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 --2- 172.21.15.5:0/3606189605 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b8071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 --2- 172.21.15.5:0/3606189605 >> v2:172.21.15.101:3300/0 conn(0x7ff9b806a1c0 0x7ff9b806a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.835+0000 7ff9bca35700 1 -- 172.21.15.5:0/3606189605 >> 172.21.15.5:0/3606189605 conn(0x7ff9b80b1900 msgr2=0x7ff9b80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.836+0000 7ff9bca35700 1 -- 172.21.15.5:0/3606189605 shutdown_connections 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.836+0000 7ff9bca35700 1 -- 172.21.15.5:0/3606189605 wait complete. 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.837+0000 7ff9bca35700 1 Processor -- start 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.837+0000 7ff9bca35700 1 -- start start 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 0x7ff9b80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b815d590 con 0x7ff9b806a1c0 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b81f6c70 con 0x7ff9b80cc730 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9bca35700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80b14f0 con 0x7ff9b815b020 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43862/0 (socket says 172.21.15.5:43862) 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 -- 172.21.15.5:0/382668376 learned_addr learned my addr 172.21.15.5:0/382668376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b5d9b700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 0x7ff9b80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b6d9d700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 -- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 msgr2=0x7ff9b815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 -- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 msgr2=0x7ff9b80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 0x7ff9b80b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 -- 172.21.15.5:0/382668376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009b30 con 0x7ff9b806a1c0 2023-08-09T14:16:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b5d9b700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 0x7ff9b80b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9b659c700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00e810 tx=0x7ff9ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.838+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00c020 con 0x7ff9b806a1c0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.839+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac004250 con 0x7ff9b806a1c0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.839+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b815c910 con 0x7ff9b806a1c0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.839+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0036a0 con 0x7ff9b806a1c0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.839+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b815ced0 con 0x7ff9b806a1c0 2023-08-09T14:16:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.839+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b815d800 con 0x7ff9b806a1c0 2023-08-09T14:16:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.840+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff9ac003800 con 0x7ff9b806a1c0 2023-08-09T14:16:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.840+0000 7ff9a6ffd700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 0x7ff99806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.840+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9ac087ff0 con 0x7ff9b806a1c0 2023-08-09T14:16:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.841+0000 7ff9b5d9b700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 0x7ff99806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.841+0000 7ff9b5d9b700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 0x7ff99806c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9b81f5c80 tx=0x7ff9a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:04.845+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff9ac0536e0 con 0x7ff9b806a1c0 2023-08-09T14:16:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.043+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b8074600 con 0x7ff9b806a1c0 2023-08-09T14:16:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.045+0000 7ff9a6ffd700 1 -- 172.21.15.5:0/382668376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7ff9ac056d00 con 0x7ff9b806a1c0 2023-08-09T14:16:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:05.047 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 msgr2=0x7ff99806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 0x7ff99806c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9b81f5c80 tx=0x7ff9a8008040 comp rx=0 tx=0).stop 2023-08-09T14:16:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 msgr2=0x7ff9b81f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00e810 tx=0x7ff9ac00ebd0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 shutdown_connections 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff99806a0e0 0x7ff99806c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff9b815b020 0x7ff9b815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9b806a1c0 0x7ff9b81f6730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 --2- 172.21.15.5:0/382668376 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff9b80cc730 0x7ff9b80b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 >> 172.21.15.5:0/382668376 conn(0x7ff9b80b1900 msgr2=0x7ff9b80c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 shutdown_connections 2023-08-09T14:16:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.047+0000 7ff9bca35700 1 -- 172.21.15.5:0/382668376 wait complete. 2023-08-09T14:16:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:05.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:05.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.189+0000 7fba0d5a9700 1 Processor -- start 2023-08-09T14:16:05.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.189+0000 7fba0d5a9700 1 -- start start 2023-08-09T14:16:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba0d5a9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba080cdf80 0x7fba0806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba0d5a9700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 0x7fba080af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba0d5a9700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba08160cc0 con 0x7fba0815d100 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba0d5a9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080d08c0 con 0x7fba080cdf80 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba0d5a9700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080cecd0 con 0x7fba080d04b0 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba080cdf80 0x7fba0806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba080cdf80 0x7fba0806cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43872/0 (socket says 172.21.15.5:43872) 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 -- 172.21.15.5:0/1018894641 learned_addr learned my addr 172.21.15.5:0/1018894641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba077fe700 1 --2- 172.21.15.5:0/1018894641 >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 0x7fba080af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 -- 172.21.15.5:0/1018894641 >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 msgr2=0x7fba080af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 --2- 172.21.15.5:0/1018894641 >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 0x7fba080af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 -- 172.21.15.5:0/1018894641 >> v1:172.21.15.101:6789/0 conn(0x7fba0815d100 legacy=0x7fba080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 -- 172.21.15.5:0/1018894641 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080d0b50 con 0x7fba080cdf80 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba077fe700 1 --2- 172.21.15.5:0/1018894641 >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 0x7fba080af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba067fc700 1 --2- 172.21.15.5:0/1018894641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080cdf80 0x7fba0806cf00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba080c4940 tx=0x7fb9f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925e66e61df3d22a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba05ffb700 1 -- 172.21.15.5:0/1018894641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004230 con 0x7fba080cdf80 2023-08-09T14:16:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba05ffb700 1 -- 172.21.15.5:0/1018894641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8004390 con 0x7fba080cdf80 2023-08-09T14:16:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.190+0000 7fba05ffb700 1 -- 172.21.15.5:0/1018894641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80036a0 con 0x7fba080cdf80 2023-08-09T14:16:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 -- 172.21.15.5:0/1018894641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080cdf80 msgr2=0x7fba0806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/1018894641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080cdf80 0x7fba0806cf00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba080c4940 tx=0x7fb9f8009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 -- 172.21.15.5:0/1018894641 shutdown_connections 2023-08-09T14:16:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/1018894641 >> v2:172.21.15.101:3300/0 conn(0x7fba080d04b0 0x7fba080af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/1018894641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080cdf80 0x7fba0806cf00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 -- 172.21.15.5:0/1018894641 >> 172.21.15.5:0/1018894641 conn(0x7fba0806dec0 msgr2=0x7fba0806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 -- 172.21.15.5:0/1018894641 shutdown_connections 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.191+0000 7fba0d5a9700 1 -- 172.21.15.5:0/1018894641 wait complete. 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.192+0000 7fba0d5a9700 1 Processor -- start 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.192+0000 7fba0d5a9700 1 -- start start 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fba080cdf80 0x7fba08159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fba0815d100 0x7fba080c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba080cbf50 con 0x7fba080d04b0 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba080cc1a0 con 0x7fba0815d100 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba0d5a9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba080cc480 con 0x7fba080cdf80 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba067fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba067fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43878/0 (socket says 172.21.15.5:43878) 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba067fc700 1 -- 172.21.15.5:0/346857011 learned_addr learned my addr 172.21.15.5:0/346857011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba077fe700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fba0815d100 0x7fba080c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.193+0000 7fba06ffd700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fba080cdf80 0x7fba08159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 -- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fba080cdf80 msgr2=0x7fba08159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fba080cdf80 0x7fba08159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 -- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fba0815d100 msgr2=0x7fba080c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fba0815d100 0x7fba080c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 -- 172.21.15.5:0/346857011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009550 con 0x7fba080d04b0 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba067fc700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba080b3a50 tx=0x7fb9f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8003d80 con 0x7fba080d04b0 2023-08-09T14:16:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801f070 con 0x7fba080d04b0 2023-08-09T14:16:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba080cc760 con 0x7fba080d04b0 2023-08-09T14:16:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8011870 con 0x7fba080d04b0 2023-08-09T14:16:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.194+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba080ccd20 con 0x7fba080d04b0 2023-08-09T14:16:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.195+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba08074600 con 0x7fba080d04b0 2023-08-09T14:16:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.195+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9f8021030 con 0x7fba080d04b0 2023-08-09T14:16:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.196+0000 7fb9ef7fe700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 0x7fb9f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.196+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9f8089ba0 con 0x7fba080d04b0 2023-08-09T14:16:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.196+0000 7fba06ffd700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 0x7fb9f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.196+0000 7fba06ffd700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 0x7fb9f406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.200+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb9f8055440 con 0x7fba080d04b0 2023-08-09T14:16:05.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.401+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba0806feb0 con 0x7fba080d04b0 2023-08-09T14:16:05.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.402+0000 7fb9ef7fe700 1 -- 172.21.15.5:0/346857011 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb9f8058a60 con 0x7fba080d04b0 2023-08-09T14:16:05.404 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 msgr2=0x7fb9f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 0x7fb9f406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc008040 comp rx=0 tx=0).stop 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 msgr2=0x7fba080c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba080b3a50 tx=0x7fb9f8004750 comp rx=0 tx=0).stop 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 shutdown_connections 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb9f406a0e0 0x7fb9f406c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fba0815d100 0x7fba080c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fba080cdf80 0x7fba08159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 --2- 172.21.15.5:0/346857011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba080d04b0 0x7fba080c8940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 >> 172.21.15.5:0/346857011 conn(0x7fba0806dec0 msgr2=0x7fba080700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 shutdown_connections 2023-08-09T14:16:05.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.404+0000 7fba0d5a9700 1 -- 172.21.15.5:0/346857011 wait complete. 2023-08-09T14:16:05.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.544+0000 7f27e59e4700 1 Processor -- start 2023-08-09T14:16:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 -- start start 2023-08-09T14:16:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e0160c90 0x7f27e00d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27e00d0130 0x7f27e00d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00b40b0 con 0x7f27e00cfd50 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00ce7a0 con 0x7f27e00d0130 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.545+0000 7f27e59e4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b48c0 con 0x7f27e0160c90 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27e00d0130 0x7f27e00d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27e00d0130 0x7f27e00d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43888/0 (socket says 172.21.15.5:43888) 2023-08-09T14:16:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 -- 172.21.15.5:0/3342850734 learned_addr learned my addr 172.21.15.5:0/3342850734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27de7fc700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e0160c90 0x7f27e00d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 -- 172.21.15.5:0/3342850734 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e0160c90 msgr2=0x7f27e00d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e0160c90 0x7f27e00d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 -- 172.21.15.5:0/3342850734 >> v1:172.21.15.101:6789/0 conn(0x7f27e00cfd50 legacy=0x7f27e0160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 -- 172.21.15.5:0/3342850734 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00cf180 con 0x7f27e00d0130 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27df7fe700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e00d0130 0x7f27e00d0cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009e50 tx=0x7f27d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89a6b8e01b01f4e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27ddffb700 1 -- 172.21.15.5:0/3342850734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800e070 con 0x7f27e00d0130 2023-08-09T14:16:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27ddffb700 1 -- 172.21.15.5:0/3342850734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d800b910 con 0x7f27e00d0130 2023-08-09T14:16:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.546+0000 7f27ddffb700 1 -- 172.21.15.5:0/3342850734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800bcc0 con 0x7f27e00d0130 2023-08-09T14:16:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 -- 172.21.15.5:0/3342850734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e00d0130 msgr2=0x7f27e00d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e00d0130 0x7f27e00d0cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009e50 tx=0x7f27d800b330 comp rx=0 tx=0).stop 2023-08-09T14:16:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 -- 172.21.15.5:0/3342850734 shutdown_connections 2023-08-09T14:16:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e00d0130 0x7f27e00d0cc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 --2- 172.21.15.5:0/3342850734 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e0160c90 0x7f27e00d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 -- 172.21.15.5:0/3342850734 >> 172.21.15.5:0/3342850734 conn(0x7f27e00d30f0 msgr2=0x7f27e00d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 -- 172.21.15.5:0/3342850734 shutdown_connections 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.547+0000 7f27e59e4700 1 -- 172.21.15.5:0/3342850734 wait complete. 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.548+0000 7f27e59e4700 1 Processor -- start 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.548+0000 7f27e59e4700 1 -- start start 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 0x7f27e00afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e00d0130 0x7f27e00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e014e570 con 0x7f27e0160c90 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e014adf0 con 0x7f27e00cfd50 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27e59e4700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e014b0d0 con 0x7f27e00d0130 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43894/0 (socket says 172.21.15.5:43894) 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 -- 172.21.15.5:0/1389759831 learned_addr learned my addr 172.21.15.5:0/1389759831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27de7fc700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e00d0130 0x7f27e00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27deffd700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 0x7f27e00afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 -- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e00d0130 msgr2=0x7f27e00b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e00d0130 0x7f27e00b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 -- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 msgr2=0x7f27e00afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 0x7f27e00afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27df7fe700 1 -- 172.21.15.5:0/1389759831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8009b30 con 0x7f27e0160c90 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.549+0000 7f27deffd700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 0x7f27e00afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27df7fe700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27e0066f30 tx=0x7f27d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80048b0 con 0x7f27e0160c90 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d80099b0 con 0x7f27e0160c90 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d801c680 con 0x7f27e0160c90 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00cbda0 con 0x7f27e0160c90 2023-08-09T14:16:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.550+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00cc360 con 0x7f27e0160c90 2023-08-09T14:16:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.551+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0074600 con 0x7f27e0160c90 2023-08-09T14:16:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.551+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27d801c7e0 con 0x7f27e0160c90 2023-08-09T14:16:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.551+0000 7f27c7fff700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 0x7f27cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.552+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27d808a1e0 con 0x7f27e0160c90 2023-08-09T14:16:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.552+0000 7f27deffd700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 0x7f27cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.552+0000 7f27deffd700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 0x7f27cc06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f60 tx=0x7f27d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.556+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f27d8055960 con 0x7f27e0160c90 2023-08-09T14:16:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.755+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27e00b0280 con 0x7f27e0160c90 2023-08-09T14:16:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.756+0000 7f27c7fff700 1 -- 172.21.15.5:0/1389759831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27d8058f80 con 0x7f27e0160c90 2023-08-09T14:16:05.757 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 msgr2=0x7f27cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 0x7f27cc06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f60 tx=0x7f27d4009040 comp rx=0 tx=0).stop 2023-08-09T14:16:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 msgr2=0x7f27e014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27e0066f30 tx=0x7f27d8004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 shutdown_connections 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27cc06a0e0 0x7f27cc06c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e0160c90 0x7f27e014a280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27e00cfd50 0x7f27e00afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 --2- 172.21.15.5:0/1389759831 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27e00d0130 0x7f27e00b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 >> 172.21.15.5:0/1389759831 conn(0x7f27e00d30f0 msgr2=0x7f27e006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 shutdown_connections 2023-08-09T14:16:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.758+0000 7f27e59e4700 1 -- 172.21.15.5:0/1389759831 wait complete. 2023-08-09T14:16:05.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.897+0000 7f741ebe2700 1 Processor -- start 2023-08-09T14:16:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 -- start start 2023-08-09T14:16:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f741806b2e0 0x7f74180cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74180b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741806be90 con 0x7f74180aeb40 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180d02a0 con 0x7f741806b2e0 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.898+0000 7f741ebe2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ccc70 con 0x7f741806d960 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f741806b2e0 0x7f74180cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f741806b2e0 0x7f74180cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43900/0 (socket says 172.21.15.5:43900) 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 -- 172.21.15.5:0/951155349 learned_addr learned my addr 172.21.15.5:0/951155349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f741d17f700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74180b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 -- 172.21.15.5:0/951155349 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 msgr2=0x7f74180b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74180b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 -- 172.21.15.5:0/951155349 >> v1:172.21.15.101:6789/0 conn(0x7f74180aeb40 legacy=0x7f741806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 -- 172.21.15.5:0/951155349 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180ce2e0 con 0x7f741806b2e0 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f7417fff700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74180cc730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74040098f0 tx=0x7f7404009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd81cc5c331c3e69 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f74177fe700 1 -- 172.21.15.5:0/951155349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404010800 con 0x7f741806b2e0 2023-08-09T14:16:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f74177fe700 1 -- 172.21.15.5:0/951155349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404010960 con 0x7f741806b2e0 2023-08-09T14:16:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.899+0000 7f74177fe700 1 -- 172.21.15.5:0/951155349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404010cf0 con 0x7f741806b2e0 2023-08-09T14:16:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 -- 172.21.15.5:0/951155349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 msgr2=0x7f74180cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74180cc730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74040098f0 tx=0x7f7404009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 -- 172.21.15.5:0/951155349 shutdown_connections 2023-08-09T14:16:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74180b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 --2- 172.21.15.5:0/951155349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74180cc730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 -- 172.21.15.5:0/951155349 >> 172.21.15.5:0/951155349 conn(0x7f74180cf4d0 msgr2=0x7f74180cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 -- 172.21.15.5:0/951155349 shutdown_connections 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.900+0000 7f741ebe2700 1 -- 172.21.15.5:0/951155349 wait complete. 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.901+0000 7f741ebe2700 1 Processor -- start 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.901+0000 7f741ebe2700 1 -- start start 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74181f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 0x7f74181f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74181e54e0 con 0x7f741806b2e0 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74181f6c50 con 0x7f741815c150 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741ebe2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74181f63b0 con 0x7f741806d960 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43904/0 (socket says 172.21.15.5:43904) 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 -- 172.21.15.5:0/2969156116 learned_addr learned my addr 172.21.15.5:0/2969156116 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f7417fff700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74181f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 -- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 msgr2=0x7f74181f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741d17f700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 0x7f74181f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74181f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 -- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 msgr2=0x7f74181f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 0x7f74181f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 -- 172.21.15.5:0/2969156116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009550 con 0x7f741806b2e0 2023-08-09T14:16:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f7417fff700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74181f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741d17f700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 0x7f74181f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.902+0000 7f741c97e700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c4d0 tx=0x7f740c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0052d0 con 0x7f741806b2e0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c005430 con 0x7f741806b2e0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0038f0 con 0x7f741806b2e0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74181f6690 con 0x7f741806b2e0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74181f2880 con 0x7f741806b2e0 2023-08-09T14:16:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.903+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418074600 con 0x7f741806b2e0 2023-08-09T14:16:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.904+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f740c003a50 con 0x7f741806b2e0 2023-08-09T14:16:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.904+0000 7f74157fa700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.905+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f740c087950 con 0x7f741806b2e0 2023-08-09T14:16:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.905+0000 7f7417fff700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.905+0000 7f7417fff700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74040098f0 tx=0x7f7404008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:05.909+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f740c0530d0 con 0x7f741806b2e0 2023-08-09T14:16:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.108+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74181f2a40 con 0x7f741806b2e0 2023-08-09T14:16:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.108+0000 7f74157fa700 1 -- 172.21.15.5:0/2969156116 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f740c0566f0 con 0x7f741806b2e0 2023-08-09T14:16:06.110 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 msgr2=0x7f73fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74040098f0 tx=0x7f7404008030 comp rx=0 tx=0).stop 2023-08-09T14:16:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 msgr2=0x7f74181f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c4d0 tx=0x7f740c00c890 comp rx=0 tx=0).stop 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 shutdown_connections 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f741815c150 0x7f74181f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741806b2e0 0x7f74181f5cd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 --2- 172.21.15.5:0/2969156116 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f741806d960 0x7f74181f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 >> 172.21.15.5:0/2969156116 conn(0x7f74180cf4d0 msgr2=0x7f741806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 shutdown_connections 2023-08-09T14:16:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.111+0000 7f741ebe2700 1 -- 172.21.15.5:0/2969156116 wait complete. 2023-08-09T14:16:06.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.251+0000 7f098aebb700 1 Processor -- start 2023-08-09T14:16:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.251+0000 7f098aebb700 1 -- start start 2023-08-09T14:16:06.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f098aebb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09840b2ff0 0x7f098415f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f098aebb700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f09840cb4b0 0x7f0984151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f098aebb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840cf500 con 0x7f09840b6170 2023-08-09T14:16:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f098aebb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098415fc90 con 0x7f09840b2ff0 2023-08-09T14:16:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f098aebb700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840cf990 con 0x7f09840cb4b0 2023-08-09T14:16:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09840b2ff0 0x7f098415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09840b2ff0 0x7f098415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43914/0 (socket says 172.21.15.5:43914) 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 -- 172.21.15.5:0/3268462931 learned_addr learned my addr 172.21.15.5:0/3268462931 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0988c57700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09840b6170 0x7f09840b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57328/0 (socket says 172.21.15.5:57328) 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0989458700 1 --2- 172.21.15.5:0/3268462931 >> v2:172.21.15.101:3300/0 conn(0x7f09840cb4b0 0x7f0984151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 -- 172.21.15.5:0/3268462931 >> v2:172.21.15.101:3300/0 conn(0x7f09840cb4b0 msgr2=0x7f0984151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 --2- 172.21.15.5:0/3268462931 >> v2:172.21.15.101:3300/0 conn(0x7f09840cb4b0 0x7f0984151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 -- 172.21.15.5:0/3268462931 >> v1:172.21.15.5:6789/0 conn(0x7f09840b6170 legacy=0x7f09840b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 -- 172.21.15.5:0/3268462931 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098415c670 con 0x7f09840b2ff0 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f09837fe700 1 -- 172.21.15.5:0/3268462931 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434747975 0 0) 0x7f09840cf500 con 0x7f09840b6170 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.252+0000 7f0983fff700 1 --2- 172.21.15.5:0/3268462931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f098415f640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09840ce990 tx=0x7f0970009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260eda969a26dd57 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f09837fe700 1 -- 172.21.15.5:0/3268462931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000b860 con 0x7f09840b2ff0 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f09837fe700 1 -- 172.21.15.5:0/3268462931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097000b9c0 con 0x7f09840b2ff0 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f09837fe700 1 -- 172.21.15.5:0/3268462931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000bd50 con 0x7f09840b2ff0 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 -- 172.21.15.5:0/3268462931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 msgr2=0x7f098415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 --2- 172.21.15.5:0/3268462931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f098415f640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09840ce990 tx=0x7f0970009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 -- 172.21.15.5:0/3268462931 shutdown_connections 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 --2- 172.21.15.5:0/3268462931 >> v2:172.21.15.101:3300/0 conn(0x7f09840cb4b0 0x7f0984151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 --2- 172.21.15.5:0/3268462931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f098415f640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 -- 172.21.15.5:0/3268462931 >> 172.21.15.5:0/3268462931 conn(0x7f098406dec0 msgr2=0x7f098406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 -- 172.21.15.5:0/3268462931 shutdown_connections 2023-08-09T14:16:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.253+0000 7f098aebb700 1 -- 172.21.15.5:0/3268462931 wait complete. 2023-08-09T14:16:06.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.254+0000 7f098aebb700 1 Processor -- start 2023-08-09T14:16:06.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.254+0000 7f098aebb700 1 -- start start 2023-08-09T14:16:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f09840b6170 0x7f098415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f09840cb4b0 0x7f098415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841f3080 con 0x7f09840b2ff0 2023-08-09T14:16:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c7730 con 0x7f09840cb4b0 2023-08-09T14:16:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f098aebb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09841f2700 con 0x7f09840b6170 2023-08-09T14:16:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f0988c57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f0988c57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43918/0 (socket says 172.21.15.5:43918) 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f0988c57700 1 -- 172.21.15.5:0/2085405270 learned_addr learned my addr 172.21.15.5:0/2085405270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.255+0000 7f0989458700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f09840cb4b0 0x7f098415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0983fff700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f09840b6170 0x7f098415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 -- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f09840b6170 msgr2=0x7f098415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f09840b6170 0x7f098415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 -- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f09840cb4b0 msgr2=0x7f098415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f09840cb4b0 0x7f098415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 -- 172.21.15.5:0/2085405270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009550 con 0x7f09840b2ff0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f0988c57700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09780011e0 tx=0x7f097800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978004c80 con 0x7f09840b2ff0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978004e00 con 0x7f09840b2ff0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0984152ec0 con 0x7f09840b2ff0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007310 con 0x7f09840b2ff0 2023-08-09T14:16:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.256+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09841f2ca0 con 0x7f09840b2ff0 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.257+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09841f31c0 con 0x7f09840b2ff0 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.257+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0978007470 con 0x7f09840b2ff0 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.258+0000 7f09817fa700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.258+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09780882e0 con 0x7f09840b2ff0 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.258+0000 7f0983fff700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.258+0000 7f0983fff700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 0x7f096806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0970014040 tx=0x7f0970008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.262+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f09841f31c0 con 0x7f09840b2ff0 2023-08-09T14:16:06.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.462+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09841f31c0 con 0x7f09840b2ff0 2023-08-09T14:16:06.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.462+0000 7f09817fa700 1 -- 172.21.15.5:0/2085405270 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09841f31c0 con 0x7f09840b2ff0 2023-08-09T14:16:06.464 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 msgr2=0x7f096806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 0x7f096806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0970014040 tx=0x7f0970008030 comp rx=0 tx=0).stop 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 msgr2=0x7f0984150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09780011e0 tx=0x7f097800cae0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 shutdown_connections 2023-08-09T14:16:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f09840cb4b0 0x7f098415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b2ff0 0x7f0984150260 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 --2- 172.21.15.5:0/2085405270 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f09840b6170 0x7f098415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 >> 172.21.15.5:0/2085405270 conn(0x7f098406dec0 msgr2=0x7f0984155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 shutdown_connections 2023-08-09T14:16:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.464+0000 7f098aebb700 1 -- 172.21.15.5:0/2085405270 wait complete. 2023-08-09T14:16:06.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T14:16:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.603+0000 7f6f127ac700 1 Processor -- start 2023-08-09T14:16:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.603+0000 7f6f127ac700 1 -- start start 2023-08-09T14:16:06.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f127ac700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f0c154600 0x7f6f0c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f127ac700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f0c0ce410 0x7f6f0c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f127ac700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0cee00 con 0x7f6f0c15b360 2023-08-09T14:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f127ac700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0c15eb20 con 0x7f6f0c154600 2023-08-09T14:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f127ac700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0c15e2d0 con 0x7f6f0c0ce410 2023-08-09T14:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f0c154600 0x7f6f0c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f0c154600 0x7f6f0c15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f0c15b360 0x7f6f0c15dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57342/0 (socket says 172.21.15.5:57342) 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 -- 172.21.15.5:0/2070846626 learned_addr learned my addr 172.21.15.5:0/2070846626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f10d49700 1 --2- 172.21.15.5:0/2070846626 >> v2:172.21.15.101:3300/0 conn(0x7f6f0c0ce410 0x7f6f0c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 -- 172.21.15.5:0/2070846626 >> v2:172.21.15.101:3300/0 conn(0x7f6f0c0ce410 msgr2=0x7f6f0c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 --2- 172.21.15.5:0/2070846626 >> v2:172.21.15.101:3300/0 conn(0x7f6f0c0ce410 0x7f6f0c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 -- 172.21.15.5:0/2070846626 >> v1:172.21.15.5:6789/0 conn(0x7f6f0c15b360 legacy=0x7f6f0c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0bfff700 1 -- 172.21.15.5:0/2070846626 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c06d4f0 con 0x7f6f0c154600 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.604+0000 7f6f0affd700 1 -- 172.21.15.5:0/2070846626 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511563850 0 0) 0x7f6ef4001110 con 0x7f6f0c15b360 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f0bfff700 1 --2- 172.21.15.5:0/2070846626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c154600 0x7f6f0c15b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ca810 tx=0x7f6efc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974444aaa8e1c123 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f0affd700 1 -- 172.21.15.5:0/2070846626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00b870 con 0x7f6f0c154600 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f0affd700 1 -- 172.21.15.5:0/2070846626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc00b9d0 con 0x7f6f0c154600 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f0affd700 1 -- 172.21.15.5:0/2070846626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00bd60 con 0x7f6f0c154600 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 -- 172.21.15.5:0/2070846626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c154600 msgr2=0x7f6f0c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 --2- 172.21.15.5:0/2070846626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c154600 0x7f6f0c15b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ca810 tx=0x7f6efc009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 -- 172.21.15.5:0/2070846626 shutdown_connections 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 --2- 172.21.15.5:0/2070846626 >> v2:172.21.15.101:3300/0 conn(0x7f6f0c0ce410 0x7f6f0c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 --2- 172.21.15.5:0/2070846626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c154600 0x7f6f0c15b790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 -- 172.21.15.5:0/2070846626 >> 172.21.15.5:0/2070846626 conn(0x7f6f0c0b1900 msgr2=0x7f6f0c0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 -- 172.21.15.5:0/2070846626 shutdown_connections 2023-08-09T14:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.605+0000 7f6f127ac700 1 -- 172.21.15.5:0/2070846626 wait complete. 2023-08-09T14:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.606+0000 7f6f127ac700 1 Processor -- start 2023-08-09T14:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 -- start start 2023-08-09T14:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f0c0ce410 0x7f6f0c1581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 0x7f6f0c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c7880 con 0x7f6f0c15b360 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c1478e0 con 0x7f6f0c154600 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f127ac700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c6ee0 con 0x7f6f0c0ce410 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.607+0000 7f6f10d49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43936/0 (socket says 172.21.15.5:43936) 2023-08-09T14:16:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 -- 172.21.15.5:0/1023819203 learned_addr learned my addr 172.21.15.5:0/1023819203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f0b7fe700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 0x7f6f0c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f0bfff700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f0c0ce410 0x7f6f0c1581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 -- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f0c0ce410 msgr2=0x7f6f0c1581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f0c0ce410 0x7f6f0c1581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 -- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 msgr2=0x7f6f0c158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 0x7f6f0c158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 -- 172.21.15.5:0/1023819203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc009550 con 0x7f6f0c15b360 2023-08-09T14:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f0b7fe700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 0x7f6f0c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f10d49700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f04007e40 tx=0x7f6f0400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400eea0 con 0x7f6f0c15b360 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f04014420 con 0x7f6f0c15b360 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c0c71c0 con 0x7f6f0c15b360 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f040147b0 con 0x7f6f0c15b360 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.608+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c147540 con 0x7f6f0c15b360 2023-08-09T14:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.609+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c0c79c0 con 0x7f6f0c15b360 2023-08-09T14:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.610+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f04014910 con 0x7f6f0c15b360 2023-08-09T14:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.610+0000 7f6f08ff9700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 0x7f6eec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.610+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f04088d30 con 0x7f6f0c15b360 2023-08-09T14:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.610+0000 7f6f0bfff700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 0x7f6eec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.611+0000 7f6f0bfff700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 0x7f6eec06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6efc000c00 tx=0x7f6efc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.614+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f0c0c79c0 con 0x7f6f0c15b360 2023-08-09T14:16:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.832+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f0c0c79c0 con 0x7f6f0c15b360 2023-08-09T14:16:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.832+0000 7f6f08ff9700 1 -- 172.21.15.5:0/1023819203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f0c0c79c0 con 0x7f6f0c15b360 2023-08-09T14:16:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 msgr2=0x7f6eec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 0x7f6eec06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6efc000c00 tx=0x7f6efc008030 comp rx=0 tx=0).stop 2023-08-09T14:16:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 msgr2=0x7f6f0c0c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f04007e40 tx=0x7f6f0400e3c0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 shutdown_connections 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6eec06a0e0 0x7f6eec06c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c15b360 0x7f6f0c0c7ca0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f0c0ce410 0x7f6f0c1581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 --2- 172.21.15.5:0/1023819203 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f0c154600 0x7f6f0c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 >> 172.21.15.5:0/1023819203 conn(0x7f6f0c0b1900 msgr2=0x7f6f0c14a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 shutdown_connections 2023-08-09T14:16:06.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:06.834+0000 7f6f127ac700 1 -- 172.21.15.5:0/1023819203 wait complete. 2023-08-09T14:16:06.838 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-08-09T14:16:06.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T14:16:06.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:06.848 DEBUG:teuthology.orchestra.run.smithi101:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-09T14:16:06.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:16:06.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:06.895 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T14:16:06.961 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:06.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:06.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:06.980 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:07.037 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:07.037 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:07.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:07.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.257+0000 7fb3e095e700 1 Processor -- start 2023-08-09T14:16:07.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.257+0000 7fb3e095e700 1 -- start start 2023-08-09T14:16:07.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3e095e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3dc0ca2c0 0x7fb3dc065f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3e095e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0c6a10 con 0x7fb3dc15b320 2023-08-09T14:16:07.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3e095e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0722b0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3e095e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc072520 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3d9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3dc0ca2c0 0x7fb3dc065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3da59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3dc15b320 0x7fb3dc0c9bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57356/0 (socket says 172.21.15.5:57356) 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.258+0000 7fb3da59c700 1 -- 172.21.15.5:0/3745687028 learned_addr learned my addr 172.21.15.5:0/3745687028 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d9d9b700 1 -- 172.21.15.5:0/3745687028 >> v1:172.21.15.101:6789/0 conn(0x7fb3dc0c6630 legacy=0x7fb3dc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d9d9b700 1 -- 172.21.15.5:0/3745687028 >> v1:172.21.15.5:6789/0 conn(0x7fb3dc15b320 legacy=0x7fb3dc0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d9d9b700 1 -- 172.21.15.5:0/3745687028 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0705b0 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d9d9b700 1 --2- 172.21.15.5:0/3745687028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc065f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009840 tx=0x7fb3cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277518ec539c2df server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d959a700 1 -- 172.21.15.5:0/3745687028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011830 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d959a700 1 -- 172.21.15.5:0/3745687028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc011990 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.259+0000 7fb3d959a700 1 -- 172.21.15.5:0/3745687028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011d20 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 -- 172.21.15.5:0/3745687028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0ca2c0 msgr2=0x7fb3dc065f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 --2- 172.21.15.5:0/3745687028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc065f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009840 tx=0x7fb3cc009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 -- 172.21.15.5:0/3745687028 shutdown_connections 2023-08-09T14:16:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 --2- 172.21.15.5:0/3745687028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc065f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 -- 172.21.15.5:0/3745687028 >> 172.21.15.5:0/3745687028 conn(0x7fb3dc0cf560 msgr2=0x7fb3dc0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 -- 172.21.15.5:0/3745687028 shutdown_connections 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.260+0000 7fb3e095e700 1 -- 172.21.15.5:0/3745687028 wait complete. 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.261+0000 7fb3e095e700 1 Processor -- start 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.261+0000 7fb3e095e700 1 -- start start 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc1f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc15b320 0x7fb3dc153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c51d0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c4620 con 0x7fb3dc0ca2c0 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc157b80 con 0x7fb3dc15b320 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43946/0 (socket says 172.21.15.5:43946) 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 -- 172.21.15.5:0/1216404714 learned_addr learned my addr 172.21.15.5:0/1216404714 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3d9d9b700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc1f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3dad9d700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc15b320 0x7fb3dc153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 -- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc15b320 msgr2=0x7fb3dc153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc15b320 0x7fb3dc153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 -- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc0ca2c0 msgr2=0x7fb3dc1f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc1f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 -- 172.21.15.5:0/1216404714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0094a0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3da59c700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c480 tx=0x7fb3d000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0005d70 con 0x7fb3dc0c6630 2023-08-09T14:16:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d00070d0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0c4830 con 0x7fb3dc0c6630 2023-08-09T14:16:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.262+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007440 con 0x7fb3dc0c6630 2023-08-09T14:16:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.263+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0c4df0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.263+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc074600 con 0x7fb3dc0c6630 2023-08-09T14:16:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.264+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3d00075a0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.264+0000 7fb3caffd700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 0x7fb3bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.264+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3d0087770 con 0x7fb3dc0c6630 2023-08-09T14:16:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.265+0000 7fb3d9d9b700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 0x7fb3bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.265+0000 7fb3d9d9b700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 0x7fb3bc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0090b0 tx=0x7fb3cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.269+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb3d0052fa0 con 0x7fb3dc0c6630 2023-08-09T14:16:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.472+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3dc0c6a10 con 0x7fb3dc0c6630 2023-08-09T14:16:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.473+0000 7fb3caffd700 1 -- 172.21.15.5:0/1216404714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fb3dc0c6a10 con 0x7fb3dc0c6630 2023-08-09T14:16:07.474 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:07.475 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:07.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 msgr2=0x7fb3bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 0x7fb3bc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0090b0 tx=0x7fb3cc008030 comp rx=0 tx=0).stop 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 msgr2=0x7fb3dc0af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c480 tx=0x7fb3d000c840 comp rx=0 tx=0).stop 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 shutdown_connections 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb3bc06a0e0 0x7fb3bc06c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb3dc15b320 0x7fb3dc153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3dc0c6630 0x7fb3dc0af0d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 --2- 172.21.15.5:0/1216404714 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb3dc0ca2c0 0x7fb3dc1f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 >> 172.21.15.5:0/1216404714 conn(0x7fb3dc0cf560 msgr2=0x7fb3dc157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 shutdown_connections 2023-08-09T14:16:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.475+0000 7fb3e095e700 1 -- 172.21.15.5:0/1216404714 wait complete. 2023-08-09T14:16:07.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:07.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.615+0000 7f39df8b5700 1 Processor -- start 2023-08-09T14:16:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.615+0000 7f39df8b5700 1 -- start start 2023-08-09T14:16:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39df8b5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80b4b90 0x7f39d806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39df8b5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39d8066160 0x7f39d806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39df8b5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d80cd990 con 0x7f39d80cc650 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39df8b5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d806c5a0 con 0x7f39d8066160 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39df8b5700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80b53e0 con 0x7f39d80b4b90 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39dde52700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39d8066160 0x7f39d806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39dd651700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39d80cc650 0x7f39d806be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57370/0 (socket says 172.21.15.5:57370) 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39dde52700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39d8066160 0x7f39d806a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43958/0 (socket says 172.21.15.5:43958) 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39dd651700 1 -- 172.21.15.5:0/1060834698 learned_addr learned my addr 172.21.15.5:0/1060834698 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.616+0000 7f39dce50700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80b4b90 0x7f39d806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39dde52700 1 -- 172.21.15.5:0/1060834698 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80b4b90 msgr2=0x7f39d806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39dde52700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80b4b90 0x7f39d806a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39dde52700 1 -- 172.21.15.5:0/1060834698 >> v1:172.21.15.5:6789/0 conn(0x7f39d80cc650 legacy=0x7f39d806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39cffff700 1 -- 172.21.15.5:0/1060834698 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166605490 0 0) 0x7f39d80cd990 con 0x7f39d80cc650 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39dde52700 1 -- 172.21.15.5:0/1060834698 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80b5100 con 0x7f39d8066160 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39dde52700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d806a700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab80453636b29e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39cffff700 1 -- 172.21.15.5:0/1060834698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000e070 con 0x7f39d8066160 2023-08-09T14:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39cffff700 1 -- 172.21.15.5:0/1060834698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000bbd0 con 0x7f39d8066160 2023-08-09T14:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39cffff700 1 -- 172.21.15.5:0/1060834698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012430 con 0x7f39d8066160 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39df8b5700 1 -- 172.21.15.5:0/1060834698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 msgr2=0x7f39d806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.617+0000 7f39df8b5700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d806a700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d000b330 comp rx=0 tx=0).stop 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 -- 172.21.15.5:0/1060834698 shutdown_connections 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d806a700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 --2- 172.21.15.5:0/1060834698 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80b4b90 0x7f39d806a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 -- 172.21.15.5:0/1060834698 >> 172.21.15.5:0/1060834698 conn(0x7f39d80cf4d0 msgr2=0x7f39d80cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 -- 172.21.15.5:0/1060834698 shutdown_connections 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.618+0000 7f39df8b5700 1 -- 172.21.15.5:0/1060834698 wait complete. 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.619+0000 7f39df8b5700 1 Processor -- start 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.619+0000 7f39df8b5700 1 -- start start 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39d80b4b90 0x7f39d809c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80cc650 0x7f39d815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81f3be0 con 0x7f39d8066160 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815f700 con 0x7f39d80b4b90 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81f2f40 con 0x7f39d80cc650 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43960/0 (socket says 172.21.15.5:43960) 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 -- 172.21.15.5:0/476542834 learned_addr learned my addr 172.21.15.5:0/476542834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dde52700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80cc650 0x7f39d815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dce50700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39d80b4b90 0x7f39d809c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 -- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80cc650 msgr2=0x7f39d815f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80cc650 0x7f39d815f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 -- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39d80b4b90 msgr2=0x7f39d809c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39d80b4b90 0x7f39d809c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 -- 172.21.15.5:0/476542834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0009a70 con 0x7f39d8066160 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39dd651700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f39c80010e0 tx=0x7f39c800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80074e0 con 0x7f39d8066160 2023-08-09T14:16:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c8007660 con 0x7f39d8066160 2023-08-09T14:16:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d81f3220 con 0x7f39d8066160 2023-08-09T14:16:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.620+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8005a70 con 0x7f39d8066160 2023-08-09T14:16:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.621+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d809be00 con 0x7f39d8066160 2023-08-09T14:16:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.621+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d81f3d20 con 0x7f39d8066160 2023-08-09T14:16:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.622+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39c8005bd0 con 0x7f39d8066160 2023-08-09T14:16:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.622+0000 7f39cdffb700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 0x7f39bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.622+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39c8087a40 con 0x7f39d8066160 2023-08-09T14:16:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.623+0000 7f39dce50700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 0x7f39bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.623+0000 7f39dce50700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 0x7f39bc06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39d81f6fa0 tx=0x7f39d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.627+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f39d81f3d20 con 0x7f39d8066160 2023-08-09T14:16:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.824+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39d8074600 con 0x7f39d8066160 2023-08-09T14:16:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.825+0000 7f39cdffb700 1 -- 172.21.15.5:0/476542834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39c80170a0 con 0x7f39d8066160 2023-08-09T14:16:07.827 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 msgr2=0x7f39bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 0x7f39bc06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39d81f6fa0 tx=0x7f39d4008040 comp rx=0 tx=0).stop 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 msgr2=0x7f39d81f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f39c80010e0 tx=0x7f39c800c860 comp rx=0 tx=0).stop 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 shutdown_connections 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f39bc06a0e0 0x7f39bc06c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39d80cc650 0x7f39d815f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8066160 0x7f39d81f2910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 --2- 172.21.15.5:0/476542834 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39d80b4b90 0x7f39d809c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 >> 172.21.15.5:0/476542834 conn(0x7f39d80cf4d0 msgr2=0x7f39d806be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 shutdown_connections 2023-08-09T14:16:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.827+0000 7f39df8b5700 1 -- 172.21.15.5:0/476542834 wait complete. 2023-08-09T14:16:07.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 Processor -- start 2023-08-09T14:16:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 -- start start 2023-08-09T14:16:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f00ce410 0x7fa3f00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00cb2d0 con 0x7fa3f0159e90 2023-08-09T14:16:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00cede0 con 0x7fa3f00ce410 2023-08-09T14:16:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.968+0000 7fa3f64fa700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00cb5b0 con 0x7fa3f00b2c70 2023-08-09T14:16:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f00ce410 0x7fa3f00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f00ce410 0x7fa3f00ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43972/0 (socket says 172.21.15.5:43972) 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 -- 172.21.15.5:0/2590621905 learned_addr learned my addr 172.21.15.5:0/2590621905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3ef7fe700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 -- 172.21.15.5:0/2590621905 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 msgr2=0x7fa3f00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 -- 172.21.15.5:0/2590621905 >> v1:172.21.15.101:6789/0 conn(0x7fa3f0159e90 legacy=0x7fa3f006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 -- 172.21.15.5:0/2590621905 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00cb890 con 0x7fa3f00ce410 2023-08-09T14:16:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3f4a97700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f00ce8a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d150 tx=0x7fa3e800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce75fad80d7a6eb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3eeffd700 1 -- 172.21.15.5:0/2590621905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8010070 con 0x7fa3f00ce410 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3eeffd700 1 -- 172.21.15.5:0/2590621905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800dd10 con 0x7fa3f00ce410 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.969+0000 7fa3eeffd700 1 -- 172.21.15.5:0/2590621905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800b310 con 0x7fa3f00ce410 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 -- 172.21.15.5:0/2590621905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 msgr2=0x7fa3f00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f00ce8a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d150 tx=0x7fa3e800d460 comp rx=0 tx=0).stop 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 -- 172.21.15.5:0/2590621905 shutdown_connections 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f00ce8a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/2590621905 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 -- 172.21.15.5:0/2590621905 >> 172.21.15.5:0/2590621905 conn(0x7fa3f00b1970 msgr2=0x7fa3f00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 -- 172.21.15.5:0/2590621905 shutdown_connections 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.970+0000 7fa3f64fa700 1 -- 172.21.15.5:0/2590621905 wait complete. 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.971+0000 7fa3f64fa700 1 Processor -- start 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.971+0000 7fa3f64fa700 1 -- start start 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 0x7fa3f00b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00a9010 con 0x7fa3f00ce410 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01559f0 con 0x7fa3f0159e90 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f64fa700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00c7f90 con 0x7fa3f00b2c70 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43978/0 (socket says 172.21.15.5:43978) 2023-08-09T14:16:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 -- 172.21.15.5:0/3654641609 learned_addr learned my addr 172.21.15.5:0/3654641609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f4a97700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 0x7fa3f00b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3effff700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 -- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 msgr2=0x7fa3f00a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 -- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 msgr2=0x7fa3f00b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 0x7fa3f00b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3ef7fe700 1 -- 172.21.15.5:0/3654641609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e800bd40 con 0x7fa3f00ce410 2023-08-09T14:16:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.972+0000 7fa3f4a97700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 0x7fa3f00b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3ef7fe700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400e980 tx=0x7fa3e400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4009710 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400c850 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00c7410 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400cc00 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.973+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f00c79d0 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.974+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00c8560 con 0x7fa3f00ce410 2023-08-09T14:16:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.974+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3e4013470 con 0x7fa3f00ce410 2023-08-09T14:16:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.975+0000 7fa3ecff9700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 0x7fa3dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.975+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3e4088550 con 0x7fa3f00ce410 2023-08-09T14:16:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.975+0000 7fa3effff700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 0x7fa3dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.975+0000 7fa3effff700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 0x7fa3dc06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0000f60 tx=0x7fa3e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:07.979+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa3e4057820 con 0x7fa3f00ce410 2023-08-09T14:16:08.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.179+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3f0074600 con 0x7fa3f00ce410 2023-08-09T14:16:08.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.179+0000 7fa3ecff9700 1 -- 172.21.15.5:0/3654641609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3e40573b0 con 0x7fa3f00ce410 2023-08-09T14:16:08.181 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 msgr2=0x7fa3dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 0x7fa3dc06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0000f60 tx=0x7fa3e0009040 comp rx=0 tx=0).stop 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 msgr2=0x7fa3f01554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400e980 tx=0x7fa3e400ed40 comp rx=0 tx=0).stop 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 shutdown_connections 2023-08-09T14:16:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa3dc06a0e0 0x7fa3dc06c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa3f0159e90 0x7fa3f00b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa3f00b2c70 0x7fa3f00a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 --2- 172.21.15.5:0/3654641609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f00ce410 0x7fa3f01554b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 >> 172.21.15.5:0/3654641609 conn(0x7fa3f00b1970 msgr2=0x7fa3f00cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 shutdown_connections 2023-08-09T14:16:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.181+0000 7fa3f64fa700 1 -- 172.21.15.5:0/3654641609 wait complete. 2023-08-09T14:16:08.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:08.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.322+0000 7fb2b963f700 1 Processor -- start 2023-08-09T14:16:08.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.322+0000 7fb2b963f700 1 -- start start 2023-08-09T14:16:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b963f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2b40cfd50 0x7fb2b40d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b963f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fb2b4160c90 0x7fb2b40d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b963f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40b40b0 con 0x7fb2b40d0130 2023-08-09T14:16:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b963f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40ce7a0 con 0x7fb2b40cfd50 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b963f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40b48c0 con 0x7fb2b4160c90 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2b40cfd50 0x7fb2b40d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2b40cfd50 0x7fb2b40d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43982/0 (socket says 172.21.15.5:43982) 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 -- 172.21.15.5:0/432150353 learned_addr learned my addr 172.21.15.5:0/432150353 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b37fe700 1 --2- 172.21.15.5:0/432150353 >> v2:172.21.15.101:3300/0 conn(0x7fb2b4160c90 0x7fb2b40d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 -- 172.21.15.5:0/432150353 >> v2:172.21.15.101:3300/0 conn(0x7fb2b4160c90 msgr2=0x7fb2b40d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 --2- 172.21.15.5:0/432150353 >> v2:172.21.15.101:3300/0 conn(0x7fb2b4160c90 0x7fb2b40d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 -- 172.21.15.5:0/432150353 >> v1:172.21.15.101:6789/0 conn(0x7fb2b40d0130 legacy=0x7fb2b4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 -- 172.21.15.5:0/432150353 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40cf180 con 0x7fb2b40cfd50 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b2ffd700 1 --2- 172.21.15.5:0/432150353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40cfd50 0x7fb2b40d3c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40d0bf0 tx=0x7fb2a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d467e0548ea4f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.323+0000 7fb2b1ffb700 1 -- 172.21.15.5:0/432150353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004230 con 0x7fb2b40cfd50 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b1ffb700 1 -- 172.21.15.5:0/432150353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8004390 con 0x7fb2b40cfd50 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b1ffb700 1 -- 172.21.15.5:0/432150353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80036a0 con 0x7fb2b40cfd50 2023-08-09T14:16:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 -- 172.21.15.5:0/432150353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40cfd50 msgr2=0x7fb2b40d3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 --2- 172.21.15.5:0/432150353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40cfd50 0x7fb2b40d3c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40d0bf0 tx=0x7fb2a8009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 -- 172.21.15.5:0/432150353 shutdown_connections 2023-08-09T14:16:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 --2- 172.21.15.5:0/432150353 >> v2:172.21.15.101:3300/0 conn(0x7fb2b4160c90 0x7fb2b40d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 --2- 172.21.15.5:0/432150353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40cfd50 0x7fb2b40d3c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 -- 172.21.15.5:0/432150353 >> 172.21.15.5:0/432150353 conn(0x7fb2b40d30f0 msgr2=0x7fb2b40d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:08.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 -- 172.21.15.5:0/432150353 shutdown_connections 2023-08-09T14:16:08.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.324+0000 7fb2b963f700 1 -- 172.21.15.5:0/432150353 wait complete. 2023-08-09T14:16:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 Processor -- start 2023-08-09T14:16:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 -- start start 2023-08-09T14:16:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2b40cfd50 0x7fb2b41f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2b4160c90 0x7fb2b4149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b414ca40 con 0x7fb2b40d0130 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b414cd20 con 0x7fb2b4160c90 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b963f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b414d000 con 0x7fb2b40cfd50 2023-08-09T14:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43990/0 (socket says 172.21.15.5:43990) 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.326+0000 7fb2b27fc700 1 -- 172.21.15.5:0/1964549074 learned_addr learned my addr 172.21.15.5:0/1964549074 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b2ffd700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2b40cfd50 0x7fb2b41f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 -- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2b40cfd50 msgr2=0x7fb2b41f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b37fe700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2b4160c90 0x7fb2b4149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2b40cfd50 0x7fb2b41f3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 -- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2b4160c90 msgr2=0x7fb2b4149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2b4160c90 0x7fb2b4149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 -- 172.21.15.5:0/1964549074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009550 con 0x7fb2b40d0130 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b27fc700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4a0 tx=0x7fb2a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011790 con 0x7fb2b40d0130 2023-08-09T14:16:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a40118f0 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b414d2e0 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011ca0 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.327+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b40ccf20 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.328+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b414d500 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.329+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2a401c460 con 0x7fb2b40d0130 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.329+0000 7fb29b7fe700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 0x7fb2a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.329+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2a4088460 con 0x7fb2b40d0130 2023-08-09T14:16:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.329+0000 7fb2b2ffd700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 0x7fb2a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.330+0000 7fb2b2ffd700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 0x7fb2a006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8000c00 tx=0x7fb2a8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.334+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb2a4053ab0 con 0x7fb2b40d0130 2023-08-09T14:16:08.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.536+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2b414cb80 con 0x7fb2b40d0130 2023-08-09T14:16:08.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.536+0000 7fb29b7fe700 1 -- 172.21.15.5:0/1964549074 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2b414cb80 con 0x7fb2b40d0130 2023-08-09T14:16:08.538 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:08.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 msgr2=0x7fb2a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 0x7fb2a006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8000c00 tx=0x7fb2a8008030 comp rx=0 tx=0).stop 2023-08-09T14:16:08.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 msgr2=0x7fb2b40cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4a0 tx=0x7fb2a400c860 comp rx=0 tx=0).stop 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 shutdown_connections 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb2a006a0e0 0x7fb2a006c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2b4160c90 0x7fb2b4149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2b40cfd50 0x7fb2b41f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 --2- 172.21.15.5:0/1964549074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2b40d0130 0x7fb2b40cc9e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 >> 172.21.15.5:0/1964549074 conn(0x7fb2b40d30f0 msgr2=0x7fb2b40b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 shutdown_connections 2023-08-09T14:16:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.539+0000 7fb2b963f700 1 -- 172.21.15.5:0/1964549074 wait complete. 2023-08-09T14:16:08.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:08.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.678+0000 7f887a860700 1 Processor -- start 2023-08-09T14:16:08.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.678+0000 7f887a860700 1 -- start start 2023-08-09T14:16:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8874160a20 0x7f88740d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88740d0f90 0x7f88740d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f88740d1940 0x7f88740cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740d2180 con 0x7f8874160a20 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740cefa0 con 0x7f88740d1940 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f887a860700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740d1ea0 con 0x7f88740d0f90 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.679+0000 7f8873fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8874160a20 0x7f88740d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8874160a20 0x7f88740d3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43996/0 (socket says 172.21.15.5:43996) 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 -- 172.21.15.5:0/3681231391 learned_addr learned my addr 172.21.15.5:0/3681231391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f88737fe700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88740d0f90 0x7f88740d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8878dfd700 1 --2- 172.21.15.5:0/3681231391 >> v2:172.21.15.101:3300/0 conn(0x7f88740d1940 0x7f88740cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 -- 172.21.15.5:0/3681231391 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88740d0f90 msgr2=0x7f88740d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88740d0f90 0x7f88740d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 -- 172.21.15.5:0/3681231391 >> v2:172.21.15.101:3300/0 conn(0x7f88740d1940 msgr2=0x7f88740cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 --2- 172.21.15.5:0/3681231391 >> v2:172.21.15.101:3300/0 conn(0x7f88740d1940 0x7f88740cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 -- 172.21.15.5:0/3681231391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740ce950 con 0x7f8874160a20 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8873fff700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8874160a20 0x7f88740d3bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88740cd770 tx=0x7f885c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7955e87a08cd65f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8872ffd700 1 -- 172.21.15.5:0/3681231391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00b870 con 0x7f8874160a20 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8872ffd700 1 -- 172.21.15.5:0/3681231391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00b9d0 con 0x7f8874160a20 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.680+0000 7f8872ffd700 1 -- 172.21.15.5:0/3681231391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00bd60 con 0x7f8874160a20 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 -- 172.21.15.5:0/3681231391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8874160a20 msgr2=0x7f88740d3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8874160a20 0x7f88740d3bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88740cd770 tx=0x7f885c009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 -- 172.21.15.5:0/3681231391 shutdown_connections 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 --2- 172.21.15.5:0/3681231391 >> v2:172.21.15.101:3300/0 conn(0x7f88740d1940 0x7f88740cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8874160a20 0x7f88740d3bb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 --2- 172.21.15.5:0/3681231391 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f88740d0f90 0x7f88740d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 -- 172.21.15.5:0/3681231391 >> 172.21.15.5:0/3681231391 conn(0x7f88740d3090 msgr2=0x7f88740d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 -- 172.21.15.5:0/3681231391 shutdown_connections 2023-08-09T14:16:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.681+0000 7f887a860700 1 -- 172.21.15.5:0/3681231391 wait complete. 2023-08-09T14:16:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.682+0000 7f887a860700 1 Processor -- start 2023-08-09T14:16:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.682+0000 7f887a860700 1 -- start start 2023-08-09T14:16:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88740d1940 0x7f88741e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 0x7f88741e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c8ff0 con 0x7f88740d0f90 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c83e0 con 0x7f88740d1940 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f887a860700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c86c0 con 0x7f8874160a20 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44002/0 (socket says 172.21.15.5:44002) 2023-08-09T14:16:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 -- 172.21.15.5:0/3682874587 learned_addr learned my addr 172.21.15.5:0/3682874587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8878dfd700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 0x7f88741e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f88737fe700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88740d1940 0x7f88741e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 -- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 msgr2=0x7f88741e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 0x7f88741e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 -- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88740d1940 msgr2=0x7f88741e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88740d1940 0x7f88741e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8873fff700 1 -- 172.21.15.5:0/3682874587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009550 con 0x7f88740d0f90 2023-08-09T14:16:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.683+0000 7f8878dfd700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 0x7f88741e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f8873fff700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f885c000c00 tx=0x7f885c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c004540 con 0x7f88740d0f90 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0036a0 con 0x7f88740d0f90 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88740c89a0 con 0x7f88740d0f90 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c003a50 con 0x7f88740d0f90 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.684+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8874153b00 con 0x7f88740d0f90 2023-08-09T14:16:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.685+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874074600 con 0x7f88740d0f90 2023-08-09T14:16:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.685+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f885c021070 con 0x7f88740d0f90 2023-08-09T14:16:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.686+0000 7f8870ff9700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 0x7f885406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.686+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f885c089c20 con 0x7f88740d0f90 2023-08-09T14:16:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.686+0000 7f88737fe700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 0x7f885406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.686+0000 7f88737fe700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 0x7f885406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f887415f6b0 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.690+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f885c0553a0 con 0x7f88740d0f90 2023-08-09T14:16:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.889+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f887406be00 con 0x7f88740d0f90 2023-08-09T14:16:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.889+0000 7f8870ff9700 1 -- 172.21.15.5:0/3682874587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f885c015020 con 0x7f88740d0f90 2023-08-09T14:16:08.891 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 msgr2=0x7f885406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 0x7f885406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f887415f6b0 tx=0x7f8864008040 comp rx=0 tx=0).stop 2023-08-09T14:16:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 msgr2=0x7f88741535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f885c000c00 tx=0x7f885c004750 comp rx=0 tx=0).stop 2023-08-09T14:16:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 shutdown_connections 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f885406a0e0 0x7f885406c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f8874160a20 0x7f88741e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88740d0f90 0x7f88741535c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 --2- 172.21.15.5:0/3682874587 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f88740d1940 0x7f88741e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.891+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 >> 172.21.15.5:0/3682874587 conn(0x7f88740d3090 msgr2=0x7f88740afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.892+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 shutdown_connections 2023-08-09T14:16:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:08.892+0000 7f887a860700 1 -- 172.21.15.5:0/3682874587 wait complete. 2023-08-09T14:16:08.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T14:16:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 Processor -- start 2023-08-09T14:16:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 -- start start 2023-08-09T14:16:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c15db90 0x7fa09c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0aec20 con 0x7fa09c06b3d0 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0cb660 con 0x7fa09c15db90 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.030+0000 7fa0a322a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c15eb10 con 0x7fa09c15e680 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c15db90 0x7fa09c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c15db90 0x7fa09c0cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44010/0 (socket says 172.21.15.5:44010) 2023-08-09T14:16:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 -- 172.21.15.5:0/1225587309 learned_addr learned my addr 172.21.15.5:0/1225587309 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a17c7700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 -- 172.21.15.5:0/1225587309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 msgr2=0x7fa09c071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 -- 172.21.15.5:0/1225587309 >> v1:172.21.15.101:6789/0 conn(0x7fa09c06b3d0 legacy=0x7fa09c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 -- 172.21.15.5:0/1225587309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0cb0c0 con 0x7fa09c15db90 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa0a0fc6700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c0cefd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa09000bb90 tx=0x7fa09000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fd332cc461261d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa09b7fe700 1 -- 172.21.15.5:0/1225587309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000dd50 con 0x7fa09c15db90 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa09b7fe700 1 -- 172.21.15.5:0/1225587309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090010470 con 0x7fa09c15db90 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.031+0000 7fa09b7fe700 1 -- 172.21.15.5:0/1225587309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090010800 con 0x7fa09c15db90 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 -- 172.21.15.5:0/1225587309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 msgr2=0x7fa09c0cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c0cefd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa09000bb90 tx=0x7fa09000bea0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 -- 172.21.15.5:0/1225587309 shutdown_connections 2023-08-09T14:16:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 --2- 172.21.15.5:0/1225587309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c0cefd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 -- 172.21.15.5:0/1225587309 >> 172.21.15.5:0/1225587309 conn(0x7fa09c0cf560 msgr2=0x7fa09c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 -- 172.21.15.5:0/1225587309 shutdown_connections 2023-08-09T14:16:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.032+0000 7fa0a322a700 1 -- 172.21.15.5:0/1225587309 wait complete. 2023-08-09T14:16:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.033+0000 7fa0a322a700 1 Processor -- start 2023-08-09T14:16:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.033+0000 7fa0a322a700 1 -- start start 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa09c06b3d0 0x7fa09c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0b3940 con 0x7fa09c15db90 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0b3c20 con 0x7fa09c06b3d0 2023-08-09T14:16:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a322a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0b3f00 con 0x7fa09c15e680 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa09bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa09bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44018/0 (socket says 172.21.15.5:44018) 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa09bfff700 1 -- 172.21.15.5:0/3735512222 learned_addr learned my addr 172.21.15.5:0/3735512222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a0fc6700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa09c06b3d0 0x7fa09c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.034+0000 7fa0a17c7700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 -- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 msgr2=0x7fa09c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 -- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa09c06b3d0 msgr2=0x7fa09c0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa09c06b3d0 0x7fa09c0b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 -- 172.21.15.5:0/3735512222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09000b7f0 con 0x7fa09c15db90 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa09bfff700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa08800c450 tx=0x7fa08800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880052d0 con 0x7fa09c15db90 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088005430 con 0x7fa09c15db90 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c0b41e0 con 0x7fa09c15db90 2023-08-09T14:16:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880038c0 con 0x7fa09c15db90 2023-08-09T14:16:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.035+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c14fd50 con 0x7fa09c15db90 2023-08-09T14:16:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.036+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c066650 con 0x7fa09c15db90 2023-08-09T14:16:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.037+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa088003a20 con 0x7fa09c15db90 2023-08-09T14:16:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.037+0000 7fa0997fa700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 0x7fa08006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.037+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa088087860 con 0x7fa09c15db90 2023-08-09T14:16:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.037+0000 7fa0a0fc6700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 0x7fa08006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.038+0000 7fa0a0fc6700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 0x7fa08006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa09000bae0 tx=0x7fa090013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.041+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa088052f50 con 0x7fa09c15db90 2023-08-09T14:16:09.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.259+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa09c0b4700 con 0x7fa09c15db90 2023-08-09T14:16:09.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.259+0000 7fa0997fa700 1 -- 172.21.15.5:0/3735512222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa09c0b4700 con 0x7fa09c15db90 2023-08-09T14:16:09.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 msgr2=0x7fa08006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 0x7fa08006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa09000bae0 tx=0x7fa090013000 comp rx=0 tx=0).stop 2023-08-09T14:16:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 msgr2=0x7fa09c14ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa08800c450 tx=0x7fa08800c760 comp rx=0 tx=0).stop 2023-08-09T14:16:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 shutdown_connections 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa08006a0e0 0x7fa08006c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa09c15e680 0x7fa09c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa09c06b3d0 0x7fa09c0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 --2- 172.21.15.5:0/3735512222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15db90 0x7fa09c14ef40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 >> 172.21.15.5:0/3735512222 conn(0x7fa09c0cf560 msgr2=0x7fa09c159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 shutdown_connections 2023-08-09T14:16:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.261+0000 7fa0a322a700 1 -- 172.21.15.5:0/3735512222 wait complete. 2023-08-09T14:16:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-08-09T14:16:09.275 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-09T14:16:09.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:09.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-09T14:16:09.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:16:09.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:09.316 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-09T14:16:09.373 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:09.373 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:09.394 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:09.394 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:09.454 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:16:09.455 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:09.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:09.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 Processor -- start 2023-08-09T14:16:09.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 -- start start 2023-08-09T14:16:09.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efc100cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1006e850 con 0x7efc1006a640 2023-08-09T14:16:09.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1006db70 con 0x7efc1006a1c0 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.638+0000 7efc164bd700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1006aad0 con 0x7efc1015d400 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc14a5a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc1006a640 0x7efc1006d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57442/0 (socket says 172.21.15.5:57442) 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc14a5a700 1 -- 172.21.15.5:0/1748151154 learned_addr learned my addr 172.21.15.5:0/1748151154 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0ffff700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efc100cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771030067 0 0) 0x7efc1006e850 con 0x7efc1006a640 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf80035b0 con 0x7efc1006a640 2023-08-09T14:16:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858827648 0 0) 0x7efbf80035b0 con 0x7efc1006a640 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 msgr2=0x7efc100cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efc100cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 >> v1:172.21.15.101:6789/0 conn(0x7efc1006a1c0 legacy=0x7efc1006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100cf7b0 con 0x7efc1006a640 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7efc080019f0 con 0x7efc1006a640 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 >> v1:172.21.15.5:6789/0 conn(0x7efc1006a640 legacy=0x7efc1006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efbf8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8003f70 0x7efbf8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efbf8004d90 0x7efbf8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1006aad0 con 0x7efbf8003f70 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf800ba70 con 0x7efbf8004d90 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf800bc30 con 0x7efc1015d400 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8003f70 0x7efbf8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.639+0000 7efc0ffff700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efbf8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc14a5a700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efbf8004d90 0x7efbf8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 -- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 msgr2=0x7efbf8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efc1015d400 0x7efbf8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 -- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efbf8004d90 msgr2=0x7efbf8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efbf8004d90 0x7efbf8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 -- 172.21.15.5:0/1748151154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80035b0 con 0x7efbf8003f70 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8003f70 0x7efbf8004850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc04001980 tx=0x7efbf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bf78aab21a7064 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04016070 con 0x7efbf8003f70 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04001cf0 con 0x7efbf8003f70 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.640+0000 7efc0effd700 1 -- 172.21.15.5:0/1748151154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04001420 con 0x7efbf8003f70 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 -- 172.21.15.5:0/1748151154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8003f70 msgr2=0x7efbf8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 --2- 172.21.15.5:0/1748151154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8003f70 0x7efbf8004850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc04001980 tx=0x7efbf8005880 comp rx=0 tx=0).stop 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc14a5a700 1 -- 172.21.15.5:0/1748151154 reap_dead start 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 -- 172.21.15.5:0/1748151154 shutdown_connections 2023-08-09T14:16:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 -- 172.21.15.5:0/1748151154 >> 172.21.15.5:0/1748151154 conn(0x7efc100b1900 msgr2=0x7efc100b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 -- 172.21.15.5:0/1748151154 shutdown_connections 2023-08-09T14:16:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.641+0000 7efc164bd700 1 -- 172.21.15.5:0/1748151154 wait complete. 2023-08-09T14:16:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.642+0000 7efc164bd700 1 Processor -- start 2023-08-09T14:16:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.642+0000 7efc164bd700 1 -- start start 2023-08-09T14:16:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efbf8003f70 0x7efc100ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc100caf90 0x7efc1014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100cc010 con 0x7efc100cab10 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100cb490 con 0x7efc100caf90 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc164bd700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100cb770 con 0x7efbf8003f70 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44036/0 (socket says 172.21.15.5:44036) 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 -- 172.21.15.5:0/2546405671 learned_addr learned my addr 172.21.15.5:0/2546405671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc14a5a700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc100caf90 0x7efc1014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0ffff700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efbf8003f70 0x7efc100ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 -- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efbf8003f70 msgr2=0x7efc100ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efbf8003f70 0x7efc100ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 -- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc100caf90 msgr2=0x7efc1014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc100caf90 0x7efc1014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 -- 172.21.15.5:0/2546405671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100cba50 con 0x7efc100cab10 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.643+0000 7efc0f7fe700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c3c0 tx=0x7efc040012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04016040 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc040054e0 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc100cc010 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04007260 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1014fd10 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.644+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc10074600 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.645+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc040073c0 con 0x7efc100cab10 2023-08-09T14:16:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.645+0000 7efc0cff9700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 0x7efbfc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.646+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc040892a0 con 0x7efc100cab10 2023-08-09T14:16:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.646+0000 7efc0ffff700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 0x7efbfc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.646+0000 7efc0ffff700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 0x7efbfc06c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc00009c60 tx=0x7efc00009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.650+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efc04054b80 con 0x7efc100cab10 2023-08-09T14:16:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.850+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc100cb8b0 con 0x7efc100cab10 2023-08-09T14:16:09.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.851+0000 7efc0cff9700 1 -- 172.21.15.5:0/2546405671 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7efc100cb8b0 con 0x7efc100cab10 2023-08-09T14:16:09.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:09.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 msgr2=0x7efbfc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 0x7efbfc06c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc00009c60 tx=0x7efc00009210 comp rx=0 tx=0).stop 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 msgr2=0x7efc1014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c3c0 tx=0x7efc040012b0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 shutdown_connections 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efbfc06a0e0 0x7efbfc06c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efc100caf90 0x7efc1014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efbf8003f70 0x7efc100ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 --2- 172.21.15.5:0/2546405671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc100cab10 0x7efc1014f290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 >> 172.21.15.5:0/2546405671 conn(0x7efc100b1900 msgr2=0x7efc100cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 shutdown_connections 2023-08-09T14:16:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.853+0000 7efc164bd700 1 -- 172.21.15.5:0/2546405671 wait complete. 2023-08-09T14:16:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:09.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:09.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 Processor -- start 2023-08-09T14:16:09.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 -- start start 2023-08-09T14:16:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f39640d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640b40b0 con 0x7f3964160c90 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640cf180 con 0x7f39640d0130 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.995+0000 7f3969891700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640ce7a0 con 0x7f39640cfd50 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f39637fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3964160c90 0x7f39640d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57462/0 (socket says 172.21.15.5:57462) 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f39637fe700 1 -- 172.21.15.5:0/1132657311 learned_addr learned my addr 172.21.15.5:0/1132657311 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3962ffd700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f39640d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784151753 0 0) 0x7f39640b40b0 con 0x7f3964160c90 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035b0 con 0x7f3964160c90 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495568113 0 0) 0x7f39640cf180 con 0x7f39640d0130 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39640b40b0 con 0x7f39640d0130 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998803572 0 0) 0x7f394c0035b0 con 0x7f3964160c90 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 msgr2=0x7f39640d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f39640d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 >> v1:172.21.15.101:6789/0 conn(0x7f39640d0130 legacy=0x7f3964160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640b4300 con 0x7f3964160c90 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f395c0019f0 con 0x7f3964160c90 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3962ffd700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f39640d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 >> v1:172.21.15.5:6789/0 conn(0x7f3964160c90 legacy=0x7f39640d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f394c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f394c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640ce7a0 con 0x7f394c004100 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00bb50 con 0x7f394c004d90 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00bd10 con 0x7f39640cfd50 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f39627fc700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f394c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.996+0000 7f3962ffd700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f394c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39637fe700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 -- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 msgr2=0x7f394c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f39640cfd50 0x7f394c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 -- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f394c004d90 msgr2=0x7f394c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 -- 172.21.15.5:0/1132657311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580094a0 con 0x7f394c004100 2023-08-09T14:16:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39637fe700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f39627fc700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f394c004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3954001980 tx=0x7f394c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95023d5b380e76b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954001470 con 0x7f394c004100 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540052d0 con 0x7f394c004100 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.997+0000 7f3961ffb700 1 -- 172.21.15.5:0/1132657311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954003680 con 0x7f394c004100 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 -- 172.21.15.5:0/1132657311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 msgr2=0x7f394c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 --2- 172.21.15.5:0/1132657311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f394c004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3954001980 tx=0x7f394c005880 comp rx=0 tx=0).stop 2023-08-09T14:16:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f39637fe700 1 -- 172.21.15.5:0/1132657311 reap_dead start 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 -- 172.21.15.5:0/1132657311 shutdown_connections 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 -- 172.21.15.5:0/1132657311 >> 172.21.15.5:0/1132657311 conn(0x7f39640d30f0 msgr2=0x7f39640d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 -- 172.21.15.5:0/1132657311 shutdown_connections 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.998+0000 7f3969891700 1 -- 172.21.15.5:0/1132657311 wait complete. 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.999+0000 7f3969891700 1 Processor -- start 2023-08-09T14:16:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:09.999+0000 7f3969891700 1 -- start start 2023-08-09T14:16:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3964154400 0x7f3964154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 0x7f39640cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964159350 con 0x7f394c004100 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964153f70 con 0x7f39640cba40 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3969891700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3964153c10 con 0x7f3964154400 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44054/0 (socket says 172.21.15.5:44054) 2023-08-09T14:16:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 -- 172.21.15.5:0/3943296325 learned_addr learned my addr 172.21.15.5:0/3943296325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f39637fe700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 0x7f39640cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f39627fc700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3964154400 0x7f3964154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 -- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3964154400 msgr2=0x7f3964154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3964154400 0x7f3964154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 -- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 msgr2=0x7f39640cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 0x7f39640cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 -- 172.21.15.5:0/3943296325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39641e6f80 con 0x7f394c004100 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f39637fe700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 0x7f39640cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f3962ffd700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3958011cd0 tx=0x7f395800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.000+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958011e70 con 0x7f394c004100 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.001+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800fd40 con 0x7f394c004100 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.001+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39641e7260 con 0x7f394c004100 2023-08-09T14:16:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.001+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958014680 con 0x7f394c004100 2023-08-09T14:16:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.001+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39641e6ba0 con 0x7f394c004100 2023-08-09T14:16:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.002+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964154250 con 0x7f394c004100 2023-08-09T14:16:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.002+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39580147e0 con 0x7f394c004100 2023-08-09T14:16:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.002+0000 7f394bfff700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.002+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3958088f50 con 0x7f394c004100 2023-08-09T14:16:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.003+0000 7f39627fc700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.003+0000 7f39627fc700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 0x7f395006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3954005040 tx=0x7f395400a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.007+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f39580545b0 con 0x7f394c004100 2023-08-09T14:16:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.207+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3964153d50 con 0x7f394c004100 2023-08-09T14:16:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.208+0000 7f394bfff700 1 -- 172.21.15.5:0/3943296325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3958057bd0 con 0x7f394c004100 2023-08-09T14:16:10.210 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 msgr2=0x7f395006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 0x7f395006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3954005040 tx=0x7f395400a000 comp rx=0 tx=0).stop 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 msgr2=0x7f3964153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3958011cd0 tx=0x7f395800f520 comp rx=0 tx=0).stop 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 shutdown_connections 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f39640cba40 0x7f39640cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f394c004100 0x7f3964153140 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 --2- 172.21.15.5:0/3943296325 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3964154400 0x7f3964154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 >> 172.21.15.5:0/3943296325 conn(0x7f39640d30f0 msgr2=0x7f39641554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 shutdown_connections 2023-08-09T14:16:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.210+0000 7f3969891700 1 -- 172.21.15.5:0/3943296325 wait complete. 2023-08-09T14:16:10.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:10.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.350+0000 7f14355ac700 1 Processor -- start 2023-08-09T14:16:10.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.350+0000 7f14355ac700 1 -- start start 2023-08-09T14:16:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f14355ac700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f14300cfd50 0x7f14300d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f14355ac700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1430160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f14355ac700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14300b40b0 con 0x7f1430160ac0 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f14355ac700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300ce7a0 con 0x7f14300cfd50 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f14355ac700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300b48c0 con 0x7f14300d0130 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1430160ac0 0x7f14300c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57482/0 (socket says 172.21.15.5:57482) 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142f7fe700 1 -- 172.21.15.5:0/2072632683 learned_addr learned my addr 172.21.15.5:0/2072632683 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142effd700 1 --2- 172.21.15.5:0/2072632683 >> v2:172.21.15.101:3300/0 conn(0x7f14300cfd50 0x7f14300d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142e7fc700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1430160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518079674 0 0) 0x7f14300b40b0 con 0x7f1430160ac0 2023-08-09T14:16:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14180035b0 con 0x7f1430160ac0 2023-08-09T14:16:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 869184510 0 0) 0x7f14180035b0 con 0x7f1430160ac0 2023-08-09T14:16:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 msgr2=0x7f1430160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1430160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 >> v2:172.21.15.101:3300/0 conn(0x7f14300cfd50 msgr2=0x7f14300d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 --2- 172.21.15.5:0/2072632683 >> v2:172.21.15.101:3300/0 conn(0x7f14300cfd50 0x7f14300d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430160f30 con 0x7f1430160ac0 2023-08-09T14:16:10.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f14280019f0 con 0x7f1430160ac0 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 >> v1:172.21.15.5:6789/0 conn(0x7f1430160ac0 legacy=0x7f14300c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1418003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418003f80 0x7f1418004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1418004d90 0x7f1418005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300ce7a0 con 0x7f1418003f80 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300b48c0 con 0x7f1418004d90 2023-08-09T14:16:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.351+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141800ba60 con 0x7f14300d0130 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418003f80 0x7f1418004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142effd700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1418003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142f7fe700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1418004d90 0x7f1418005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 -- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 msgr2=0x7f1418003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f14300d0130 0x7f1418003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 -- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1418004d90 msgr2=0x7f1418005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1418004d90 0x7f1418005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 -- 172.21.15.5:0/2072632683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180035b0 con 0x7f1418003f80 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142e7fc700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418003f80 0x7f1418004850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1424009b90 tx=0x7f1418005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb82c9d0a11f0a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400e6c0 con 0x7f1418003f80 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400e820 con 0x7f1418003f80 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.352+0000 7f142dffb700 1 -- 172.21.15.5:0/2072632683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400eb90 con 0x7f1418003f80 2023-08-09T14:16:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 -- 172.21.15.5:0/2072632683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418003f80 msgr2=0x7f1418004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 --2- 172.21.15.5:0/2072632683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418003f80 0x7f1418004850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1424009b90 tx=0x7f1418005880 comp rx=0 tx=0).stop 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f142f7fe700 1 -- 172.21.15.5:0/2072632683 reap_dead start 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 -- 172.21.15.5:0/2072632683 shutdown_connections 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 -- 172.21.15.5:0/2072632683 >> 172.21.15.5:0/2072632683 conn(0x7f14300d30f0 msgr2=0x7f14300d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 -- 172.21.15.5:0/2072632683 shutdown_connections 2023-08-09T14:16:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.353+0000 7f14355ac700 1 -- 172.21.15.5:0/2072632683 wait complete. 2023-08-09T14:16:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.355+0000 7f14355ac700 1 Processor -- start 2023-08-09T14:16:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.355+0000 7f14355ac700 1 -- start start 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.355+0000 7f14355ac700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1418003f80 0x7f143014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f14300b0aa0 0x7f143015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301572d0 con 0x7f143014b620 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143015b090 con 0x7f14300b0aa0 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143015b370 con 0x7f1418003f80 2023-08-09T14:16:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44078/0 (socket says 172.21.15.5:44078) 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 -- 172.21.15.5:0/4119974487 learned_addr learned my addr 172.21.15.5:0/4119974487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142e7fc700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f14300b0aa0 0x7f143015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142effd700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1418003f80 0x7f143014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 -- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1418003f80 msgr2=0x7f143014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1418003f80 0x7f143014ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 -- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f14300b0aa0 msgr2=0x7f143015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f14300b0aa0 0x7f143015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 -- 172.21.15.5:0/4119974487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143015b650 con 0x7f143014b620 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f142f7fe700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1428001330 tx=0x7f142800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800adb0 con 0x7f143014b620 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280133f0 con 0x7f143014b620 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143014b2b0 con 0x7f143014b620 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280137a0 con 0x7f143014b620 2023-08-09T14:16:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.356+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143015ac60 con 0x7f143014b620 2023-08-09T14:16:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.357+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143015ae50 con 0x7f143014b620 2023-08-09T14:16:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.358+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1428013900 con 0x7f143014b620 2023-08-09T14:16:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.358+0000 7f14177fe700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 0x7f141c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.358+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1428089140 con 0x7f143014b620 2023-08-09T14:16:10.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.358+0000 7f142effd700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 0x7f141c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.359+0000 7f142effd700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 0x7f141c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1420009ce0 tx=0x7f1420009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.363+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f143015ae50 con 0x7f143014b620 2023-08-09T14:16:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.560+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f143015ae50 con 0x7f143014b620 2023-08-09T14:16:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.560+0000 7f14177fe700 1 -- 172.21.15.5:0/4119974487 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f143015ae50 con 0x7f143014b620 2023-08-09T14:16:10.562 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 msgr2=0x7f141c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 0x7f141c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1420009ce0 tx=0x7f1420009210 comp rx=0 tx=0).stop 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 msgr2=0x7f14300ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1428001330 tx=0x7f142800a640 comp rx=0 tx=0).stop 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 shutdown_connections 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f141c06a0e0 0x7f141c06c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f143014b620 0x7f14300ca1c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1418003f80 0x7f143014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 --2- 172.21.15.5:0/4119974487 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f14300b0aa0 0x7f143015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 >> 172.21.15.5:0/4119974487 conn(0x7f14300d30f0 msgr2=0x7f14300cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 shutdown_connections 2023-08-09T14:16:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.563+0000 7f14355ac700 1 -- 172.21.15.5:0/4119974487 wait complete. 2023-08-09T14:16:10.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:10.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.703+0000 7fbeb4f5f700 1 Processor -- start 2023-08-09T14:16:10.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.703+0000 7fbeb4f5f700 1 -- start start 2023-08-09T14:16:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeb4f5f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb015d3a0 0x7fbeb00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeb4f5f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb006a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeb4f5f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00715a0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeb4f5f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb00cd6c0 con 0x7fbeb015d3a0 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeb4f5f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb006ab30 con 0x7fbeb006a1c0 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb015d3a0 0x7fbeb00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb015d3a0 0x7fbeb00af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44082/0 (socket says 172.21.15.5:44082) 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 -- 172.21.15.5:0/1394739950 learned_addr learned my addr 172.21.15.5:0/1394739950 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeaed9d700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb006a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 -- 172.21.15.5:0/1394739950 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 msgr2=0x7fbeb006a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:10.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb006a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 -- 172.21.15.5:0/1394739950 >> v1:172.21.15.5:6789/0 conn(0x7fbeb00cd1c0 legacy=0x7fbeb00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 -- 172.21.15.5:0/1394739950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00712a0 con 0x7fbeb015d3a0 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbeae59c700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb015d3a0 0x7fbeb00af2c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbea40098f0 tx=0x7fbea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602d3d42f36ff19 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbead59a700 1 -- 172.21.15.5:0/1394739950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400b8a0 con 0x7fbeb015d3a0 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbead59a700 1 -- 172.21.15.5:0/1394739950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400ba00 con 0x7fbeb015d3a0 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.704+0000 7fbead59a700 1 -- 172.21.15.5:0/1394739950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400bd90 con 0x7fbeb015d3a0 2023-08-09T14:16:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/1394739950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb015d3a0 msgr2=0x7fbeb00af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb015d3a0 0x7fbeb00af2c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbea40098f0 tx=0x7fbea4009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/1394739950 shutdown_connections 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/1394739950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb015d3a0 0x7fbeb00af2c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/1394739950 >> 172.21.15.5:0/1394739950 conn(0x7fbeb00b1970 msgr2=0x7fbeb00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/1394739950 shutdown_connections 2023-08-09T14:16:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.705+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/1394739950 wait complete. 2023-08-09T14:16:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.707+0000 7fbeb4f5f700 1 Processor -- start 2023-08-09T14:16:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.707+0000 7fbeb4f5f700 1 -- start start 2023-08-09T14:16:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb00c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 0x7fbeb014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb00c5fe0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb00c53d0 con 0x7fbeb015d3a0 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeb4f5f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb00c56b0 con 0x7fbeb006a1c0 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44090/0 (socket says 172.21.15.5:44090) 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 -- 172.21.15.5:0/3160205405 learned_addr learned my addr 172.21.15.5:0/3160205405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeae59c700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb00c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeaed9d700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 0x7fbeb014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 -- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 msgr2=0x7fbeb00c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb00c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 -- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 msgr2=0x7fbeb014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 0x7fbeb014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 -- 172.21.15.5:0/3160205405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009550 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeaed9d700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 0x7fbeb014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.708+0000 7fbeadd9b700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c4b0 tx=0x7fbea000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.709+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea00052d0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.709+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0005430 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.709+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb00c5990 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.709+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea00038c0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.709+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb00b2c70 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.710+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb0074600 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.710+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbea0003a20 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.710+0000 7fbe9effd700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 0x7fbe9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.710+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbea00879b0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.711+0000 7fbeae59c700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 0x7fbe9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.711+0000 7fbeae59c700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 0x7fbe9006c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbea4014040 tx=0x7fbea4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.715+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbea00530a0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.914+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbeb00cc2f0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.915+0000 7fbe9effd700 1 -- 172.21.15.5:0/3160205405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbea00566c0 con 0x7fbeb00cd1c0 2023-08-09T14:16:10.917 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 msgr2=0x7fbe9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 0x7fbe9006c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbea4014040 tx=0x7fbea4008030 comp rx=0 tx=0).stop 2023-08-09T14:16:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 msgr2=0x7fbeb00c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c4b0 tx=0x7fbea000c7c0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 shutdown_connections 2023-08-09T14:16:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbe9006a0e0 0x7fbe9006c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbeb015d3a0 0x7fbeb014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbeb006a1c0 0x7fbeb00c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 --2- 172.21.15.5:0/3160205405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb00cd1c0 0x7fbeb00c4d60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 >> 172.21.15.5:0/3160205405 conn(0x7fbeb00b1970 msgr2=0x7fbeb00b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 shutdown_connections 2023-08-09T14:16:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:10.917+0000 7fbeb4f5f700 1 -- 172.21.15.5:0/3160205405 wait complete. 2023-08-09T14:16:10.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.057+0000 7f2fc4722700 1 Processor -- start 2023-08-09T14:16:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.057+0000 7f2fc4722700 1 -- start start 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc4722700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fbc0cfff0 0x7f2fbc0ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc4722700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc15e0e0 con 0x7f2fbc06d570 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc4722700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0665b0 con 0x7f2fbc071940 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc4722700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc15ec80 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc1cbd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fbc0cfff0 0x7f2fbc0ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc24be700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2fbc06d570 0x7f2fbc15e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57512/0 (socket says 172.21.15.5:57512) 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc24be700 1 -- 172.21.15.5:0/3526830823 learned_addr learned my addr 172.21.15.5:0/3526830823 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/3526830823 >> v1:172.21.15.101:6789/0 conn(0x7f2fbc071940 legacy=0x7f2fbc0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/3526830823 >> v1:172.21.15.5:6789/0 conn(0x7f2fbc06d570 legacy=0x7f2fbc15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/3526830823 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc065ff0 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc14bc700 1 -- 172.21.15.5:0/3526830823 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448229583 0 0) 0x7f2fbc15e0e0 con 0x7f2fbc06d570 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.058+0000 7f2fc1cbd700 1 --2- 172.21.15.5:0/3526830823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc0cfff0 0x7f2fbc0ceb00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009840 tx=0x7f2fb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504a8c055b454e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc14bc700 1 -- 172.21.15.5:0/3526830823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004230 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc14bc700 1 -- 172.21.15.5:0/3526830823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8004390 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc14bc700 1 -- 172.21.15.5:0/3526830823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80036a0 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 -- 172.21.15.5:0/3526830823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc0cfff0 msgr2=0x7f2fbc0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 --2- 172.21.15.5:0/3526830823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc0cfff0 0x7f2fbc0ceb00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009840 tx=0x7f2fb8009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 -- 172.21.15.5:0/3526830823 shutdown_connections 2023-08-09T14:16:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 --2- 172.21.15.5:0/3526830823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc0cfff0 0x7f2fbc0ceb00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 -- 172.21.15.5:0/3526830823 >> 172.21.15.5:0/3526830823 conn(0x7f2fbc0cf4d0 msgr2=0x7f2fbc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 -- 172.21.15.5:0/3526830823 shutdown_connections 2023-08-09T14:16:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.059+0000 7f2fc4722700 1 -- 172.21.15.5:0/3526830823 wait complete. 2023-08-09T14:16:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.060+0000 7f2fc4722700 1 Processor -- start 2023-08-09T14:16:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.060+0000 7f2fc4722700 1 -- start start 2023-08-09T14:16:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2fbc06d570 0x7f2fbc151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2fbc0cfff0 0x7f2fbc1f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09d2c0 con 0x7f2fbc071940 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09cd80 con 0x7f2fbc06d570 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc4722700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09cfe0 con 0x7f2fbc0cfff0 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc1cbd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc1cbd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44104/0 (socket says 172.21.15.5:44104) 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/61483878 learned_addr learned my addr 172.21.15.5:0/61483878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc24be700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2fbc06d570 0x7f2fbc151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.061+0000 7f2fc2cbf700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2fbc0cfff0 0x7f2fbc1f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2fbc0cfff0 msgr2=0x7f2fbc1f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2fbc0cfff0 0x7f2fbc1f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2fbc06d570 msgr2=0x7f2fbc151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2fbc06d570 0x7f2fbc151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 -- 172.21.15.5:0/61483878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094a0 con 0x7f2fbc071940 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc1cbd700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80090b0 tx=0x7f2fb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8003ea0 con 0x7f2fbc071940 2023-08-09T14:16:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb801e070 con 0x7f2fbc071940 2023-08-09T14:16:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc099450 con 0x7f2fbc071940 2023-08-09T14:16:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8011850 con 0x7f2fbc071940 2023-08-09T14:16:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.062+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc099a10 con 0x7f2fbc071940 2023-08-09T14:16:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.063+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc06e470 con 0x7f2fbc071940 2023-08-09T14:16:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.064+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2fb80119b0 con 0x7f2fbc071940 2023-08-09T14:16:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.064+0000 7f2fb2ffd700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 0x7f2fa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.064+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fb8089750 con 0x7f2fbc071940 2023-08-09T14:16:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.064+0000 7f2fc24be700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 0x7f2fa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.065+0000 7f2fc24be700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 0x7f2fa006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fac007fd0 tx=0x7f2fac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.069+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2fb8054ed0 con 0x7f2fbc071940 2023-08-09T14:16:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.265+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fbc099c00 con 0x7f2fbc071940 2023-08-09T14:16:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.266+0000 7f2fb2ffd700 1 -- 172.21.15.5:0/61483878 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fb80584f0 con 0x7f2fbc071940 2023-08-09T14:16:11.267 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:11.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 msgr2=0x7f2fa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 0x7f2fa006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fac007fd0 tx=0x7f2fac009040 comp rx=0 tx=0).stop 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 msgr2=0x7f2fbc09c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80090b0 tx=0x7f2fb8004750 comp rx=0 tx=0).stop 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 shutdown_connections 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f2fa006a0e0 0x7f2fa006c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2fbc0cfff0 0x7f2fbc1f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2fbc06d570 0x7f2fbc151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 --2- 172.21.15.5:0/61483878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc071940 0x7f2fbc09c840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 >> 172.21.15.5:0/61483878 conn(0x7f2fbc0cf4d0 msgr2=0x7f2fbc0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 shutdown_connections 2023-08-09T14:16:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.268+0000 7f2fc4722700 1 -- 172.21.15.5:0/61483878 wait complete. 2023-08-09T14:16:11.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T14:16:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.406+0000 7f3ee10a9700 1 Processor -- start 2023-08-09T14:16:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.406+0000 7f3ee10a9700 1 -- start start 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ee10a9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3edc071170 0x7f3edc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ee10a9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc06e4c0 con 0x7f3edc06a8d0 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ee10a9700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0cc170 con 0x7f3edc15b020 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ee10a9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc06eb60 con 0x7f3edc071170 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3eda59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3edc06a8d0 0x7f3edc0b2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57528/0 (socket says 172.21.15.5:57528) 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3eda59c700 1 -- 172.21.15.5:0/2139005966 learned_addr learned my addr 172.21.15.5:0/2139005966 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3edb59e700 1 --2- 172.21.15.5:0/2139005966 >> v2:172.21.15.5:3300/0 conn(0x7f3edc071170 0x7f3edc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3edb59e700 1 -- 172.21.15.5:0/2139005966 >> v1:172.21.15.101:6789/0 conn(0x7f3edc15b020 legacy=0x7f3edc06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3edb59e700 1 -- 172.21.15.5:0/2139005966 >> v1:172.21.15.5:6789/0 conn(0x7f3edc06a8d0 legacy=0x7f3edc0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ed9d9b700 1 -- 172.21.15.5:0/2139005966 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980842707 0 0) 0x7f3edc06e4c0 con 0x7f3edc06a8d0 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3edb59e700 1 -- 172.21.15.5:0/2139005966 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0cc450 con 0x7f3edc071170 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3edb59e700 1 --2- 172.21.15.5:0/2139005966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc071170 0x7f3edc0b34c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009d90 tx=0x7f3ed400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f121b81374f4f99d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ed9d9b700 1 -- 172.21.15.5:0/2139005966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400e070 con 0x7f3edc071170 2023-08-09T14:16:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.407+0000 7f3ed9d9b700 1 -- 172.21.15.5:0/2139005966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400bb90 con 0x7f3edc071170 2023-08-09T14:16:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ed9d9b700 1 -- 172.21.15.5:0/2139005966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4003a20 con 0x7f3edc071170 2023-08-09T14:16:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 -- 172.21.15.5:0/2139005966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc071170 msgr2=0x7f3edc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/2139005966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc071170 0x7f3edc0b34c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009d90 tx=0x7f3ed400b330 comp rx=0 tx=0).stop 2023-08-09T14:16:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 -- 172.21.15.5:0/2139005966 shutdown_connections 2023-08-09T14:16:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/2139005966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc071170 0x7f3edc0b34c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 -- 172.21.15.5:0/2139005966 >> 172.21.15.5:0/2139005966 conn(0x7f3edc0b1900 msgr2=0x7f3edc0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 -- 172.21.15.5:0/2139005966 shutdown_connections 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.408+0000 7f3ee10a9700 1 -- 172.21.15.5:0/2139005966 wait complete. 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 Processor -- start 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 -- start start 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3edc06a8d0 0x7f3edc1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3edc071170 0x7f3edc0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0cfa10 con 0x7f3edc15b020 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0ae220 con 0x7f3edc06a8d0 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3ee10a9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0cd940 con 0x7f3edc071170 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.410+0000 7f3edb59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44120/0 (socket says 172.21.15.5:44120) 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 -- 172.21.15.5:0/1728444628 learned_addr learned my addr 172.21.15.5:0/1728444628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edad9d700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3edc06a8d0 0x7f3edc1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3eda59c700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3edc071170 0x7f3edc0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 -- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3edc071170 msgr2=0x7f3edc0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3edc071170 0x7f3edc0b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 -- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3edc06a8d0 msgr2=0x7f3edc1f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3edc06a8d0 0x7f3edc1f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 -- 172.21.15.5:0/1728444628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4009a70 con 0x7f3edc15b020 2023-08-09T14:16:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3edb59e700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400b730 tx=0x7f3ed4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012630 con 0x7f3edc15b020 2023-08-09T14:16:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40127b0 con 0x7f3edc15b020 2023-08-09T14:16:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc0cdb90 con 0x7f3edc15b020 2023-08-09T14:16:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012b60 con 0x7f3edc15b020 2023-08-09T14:16:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.411+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc0ce150 con 0x7f3edc15b020 2023-08-09T14:16:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.412+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc074600 con 0x7f3edc15b020 2023-08-09T14:16:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.413+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ed4012cc0 con 0x7f3edc15b020 2023-08-09T14:16:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.413+0000 7f3ec37fe700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 0x7f3ec806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.414+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ed408ab00 con 0x7f3edc15b020 2023-08-09T14:16:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.414+0000 7f3edad9d700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 0x7f3ec806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.414+0000 7f3edad9d700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 0x7f3ec806c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b39c0 tx=0x7f3ecc0090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.418+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3ed4056280 con 0x7f3edc15b020 2023-08-09T14:16:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.631+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3edc0b45e0 con 0x7f3edc15b020 2023-08-09T14:16:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.631+0000 7f3ec37fe700 1 -- 172.21.15.5:0/1728444628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ed40598a0 con 0x7f3edc15b020 2023-08-09T14:16:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 msgr2=0x7f3ec806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 0x7f3ec806c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b39c0 tx=0x7f3ecc0090e0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 msgr2=0x7f3edc0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400b730 tx=0x7f3ed4004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 shutdown_connections 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3ec806a0e0 0x7f3ec806c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3edc15b020 0x7f3edc0b32f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3edc06a8d0 0x7f3edc1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 --2- 172.21.15.5:0/1728444628 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3edc071170 0x7f3edc0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 >> 172.21.15.5:0/1728444628 conn(0x7f3edc0b1900 msgr2=0x7f3edc0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 shutdown_connections 2023-08-09T14:16:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.633+0000 7f3ee10a9700 1 -- 172.21.15.5:0/1728444628 wait complete. 2023-08-09T14:16:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-08-09T14:16:11.646 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-09T14:16:11.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:11.647 DEBUG:teuthology.orchestra.run.smithi101:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-09T14:16:11.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:16:11.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:11.690 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-09T14:16:11.749 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T14:16:11.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:11.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.879+0000 7f01893d0700 1 Processor -- start 2023-08-09T14:16:11.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.879+0000 7f01893d0700 1 -- start start 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01893d0700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f018406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01893d0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01840ce050 con 0x7f01840cc780 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01893d0700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018406e850 con 0x7f018415d400 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01893d0700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018406ab80 con 0x7f018406a1c0 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01837fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01840cc780 0x7f01840ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57544/0 (socket says 172.21.15.5:57544) 2023-08-09T14:16:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.880+0000 7f01837fe700 1 -- 172.21.15.5:0/3727748465 learned_addr learned my addr 172.21.15.5:0/3727748465 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f01827fc700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f018406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201866501 0 0) 0x7f01840ce050 con 0x7f01840cc780 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c0035b0 con 0x7f01840cc780 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700297201 0 0) 0x7f018406e850 con 0x7f018415d400 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01840ce050 con 0x7f018415d400 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244929550 0 0) 0x7f016c0035b0 con 0x7f01840cc780 2023-08-09T14:16:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 msgr2=0x7f018406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f018406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 >> v1:172.21.15.101:6789/0 conn(0x7f018415d400 legacy=0x7f01840cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01840cf7b0 con 0x7f01840cc780 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f017c0019f0 con 0x7f01840cc780 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 >> v1:172.21.15.5:6789/0 conn(0x7f01840cc780 legacy=0x7f01840ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f016c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f016c004170 0x7f016c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016c004d90 0x7f016c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018406ab80 con 0x7f016c004d90 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c00bb50 con 0x7f016c004170 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c00bd10 con 0x7f018406a1c0 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f01837fe700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016c004d90 0x7f016c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f01827fc700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f016c004170 0x7f016c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.881+0000 7f0182ffd700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f016c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 -- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 msgr2=0x7f016c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f018406a1c0 0x7f016c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 -- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f016c004170 msgr2=0x7f016c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f016c004170 0x7f016c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 -- 172.21.15.5:0/3727748465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0035b0 con 0x7f016c004d90 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016c004d90 0x7f016c005210 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a710 tx=0x7f016c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead656c3105ea063 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0072d0 con 0x7f016c004d90 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c007430 con 0x7f016c004d90 2023-08-09T14:16:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f0181ffb700 1 -- 172.21.15.5:0/3727748465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0077e0 con 0x7f016c004d90 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 -- 172.21.15.5:0/3727748465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016c004d90 msgr2=0x7f016c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 --2- 172.21.15.5:0/3727748465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016c004d90 0x7f016c005210 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a710 tx=0x7f016c005880 comp rx=0 tx=0).stop 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01837fe700 1 -- 172.21.15.5:0/3727748465 reap_dead start 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 -- 172.21.15.5:0/3727748465 shutdown_connections 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 -- 172.21.15.5:0/3727748465 >> 172.21.15.5:0/3727748465 conn(0x7f01840b1900 msgr2=0x7f01840b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 -- 172.21.15.5:0/3727748465 shutdown_connections 2023-08-09T14:16:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.882+0000 7f01893d0700 1 -- 172.21.15.5:0/3727748465 wait complete. 2023-08-09T14:16:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.884+0000 7f01893d0700 1 Processor -- start 2023-08-09T14:16:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.884+0000 7f01893d0700 1 -- start start 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f01841618b0 0x7f01840c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 0x7f0184156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01840cc470 con 0x7f0184155360 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0184161420 con 0x7f01840c3de0 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01840c6720 con 0x7f01841618b0 2023-08-09T14:16:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44136/0 (socket says 172.21.15.5:44136) 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 -- 172.21.15.5:0/3059592144 learned_addr learned my addr 172.21.15.5:0/3059592144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01837fe700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 0x7f0184156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01827fc700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f01841618b0 0x7f01840c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 -- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f01841618b0 msgr2=0x7f01840c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f01841618b0 0x7f01840c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 -- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 msgr2=0x7f0184156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 0x7f0184156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 -- 172.21.15.5:0/3059592144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184161d30 con 0x7f0184155360 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01837fe700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 0x7f0184156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f0182ffd700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f017800f870 tx=0x7f017800fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800fe70 con 0x7f0184155360 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780052e0 con 0x7f0184155360 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01840cc190 con 0x7f0184155360 2023-08-09T14:16:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178003680 con 0x7f0184155360 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.885+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018415f250 con 0x7f0184155360 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.886+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018415f3e0 con 0x7f0184155360 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.887+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01780037e0 con 0x7f0184155360 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.887+0000 7f016b7fe700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 0x7f017006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.888+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0178088540 con 0x7f0184155360 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.888+0000 7f01827fc700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 0x7f017006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.888+0000 7f01827fc700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 0x7f017006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01840c5e70 tx=0x7f0174008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:11.892+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0178053cc0 con 0x7f0184155360 2023-08-09T14:16:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.139+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0184074600 con 0x7f0184155360 2023-08-09T14:16:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.139+0000 7f016b7fe700 1 -- 172.21.15.5:0/3059592144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7f01780572e0 con 0x7f0184155360 2023-08-09T14:16:12.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:12.141 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 msgr2=0x7f017006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 0x7f017006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01840c5e70 tx=0x7f0174008040 comp rx=0 tx=0).stop 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 msgr2=0x7f01840c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f017800f870 tx=0x7f017800fc30 comp rx=0 tx=0).stop 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 shutdown_connections 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f017006a0e0 0x7f017006c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f01840c3de0 0x7f0184156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0184155360 0x7f01840c2fb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 --2- 172.21.15.5:0/3059592144 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f01841618b0 0x7f01840c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 >> 172.21.15.5:0/3059592144 conn(0x7f01840b1900 msgr2=0x7f01840afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 shutdown_connections 2023-08-09T14:16:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.141+0000 7f01893d0700 1 -- 172.21.15.5:0/3059592144 wait complete. 2023-08-09T14:16:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:16:12.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.279+0000 7f4f03ab5700 1 Processor -- start 2023-08-09T14:16:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.279+0000 7f4f03ab5700 1 -- start start 2023-08-09T14:16:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f03ab5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4efc0b2110 0x7f4efc0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f03ab5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0cb640 con 0x7f4efc15d490 2023-08-09T14:16:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f03ab5700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0cb920 con 0x7f4efc0cfe40 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f03ab5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc0cbc00 con 0x7f4efc0b2110 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01050700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4efc0b2110 0x7f4efc0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01851700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4efc15d490 0x7f4efc0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57560/0 (socket says 172.21.15.5:57560) 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01050700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4efc0b2110 0x7f4efc0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44146/0 (socket says 172.21.15.5:44146) 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01851700 1 -- 172.21.15.5:0/1043408952 learned_addr learned my addr 172.21.15.5:0/1043408952 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01050700 1 -- 172.21.15.5:0/1043408952 >> v1:172.21.15.101:6789/0 conn(0x7f4efc0cfe40 legacy=0x7f4efc06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.280+0000 7f4f01050700 1 -- 172.21.15.5:0/1043408952 >> v1:172.21.15.5:6789/0 conn(0x7f4efc15d490 legacy=0x7f4efc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f01050700 1 -- 172.21.15.5:0/1043408952 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0cbee0 con 0x7f4efc0b2110 2023-08-09T14:16:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f01050700 1 --2- 172.21.15.5:0/1043408952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0cf900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009840 tx=0x7f4ef8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d1f3dae0b3963 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f0084f700 1 -- 172.21.15.5:0/1043408952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011830 con 0x7f4efc0b2110 2023-08-09T14:16:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f0084f700 1 -- 172.21.15.5:0/1043408952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8011990 con 0x7f4efc0b2110 2023-08-09T14:16:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f0084f700 1 -- 172.21.15.5:0/1043408952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011d20 con 0x7f4efc0b2110 2023-08-09T14:16:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f03ab5700 1 -- 172.21.15.5:0/1043408952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 msgr2=0x7f4efc0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/1043408952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0cf900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009840 tx=0x7f4ef8009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f03ab5700 1 -- 172.21.15.5:0/1043408952 shutdown_connections 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/1043408952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0cf900 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.281+0000 7f4f03ab5700 1 -- 172.21.15.5:0/1043408952 >> 172.21.15.5:0/1043408952 conn(0x7f4efc09a180 msgr2=0x7f4efc0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.282+0000 7f4f03ab5700 1 -- 172.21.15.5:0/1043408952 shutdown_connections 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.282+0000 7f4f03ab5700 1 -- 172.21.15.5:0/1043408952 wait complete. 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 Processor -- start 2023-08-09T14:16:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 -- start start 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4efc0cfe40 0x7f4efc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4efc15d490 0x7f4efc0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0c58e0 con 0x7f4efc0b2110 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0c5bc0 con 0x7f4efc0cfe40 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.283+0000 7f4f03ab5700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0c5ea0 con 0x7f4efc15d490 2023-08-09T14:16:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44150/0 (socket says 172.21.15.5:44150) 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 -- 172.21.15.5:0/3342975042 learned_addr learned my addr 172.21.15.5:0/3342975042 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01050700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4efc0cfe40 0x7f4efc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f02052700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4efc15d490 0x7f4efc0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 -- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4efc15d490 msgr2=0x7f4efc0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4efc15d490 0x7f4efc0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 -- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4efc0cfe40 msgr2=0x7f4efc0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4efc0cfe40 0x7f4efc0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 -- 172.21.15.5:0/3342975042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80094a0 con 0x7f4efc0b2110 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f01851700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c480 tx=0x7f4eec00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec005d70 con 0x7f4efc0b2110 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec0070d0 con 0x7f4efc0b2110 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc0c6180 con 0x7f4efc0b2110 2023-08-09T14:16:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec007440 con 0x7f4efc0b2110 2023-08-09T14:16:12.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.284+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc0c7620 con 0x7f4efc0b2110 2023-08-09T14:16:12.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.285+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc074600 con 0x7f4efc0b2110 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.286+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4eec0075a0 con 0x7f4efc0b2110 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.286+0000 7f4ef27fc700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 0x7f4ee006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.286+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4eec0879c0 con 0x7f4efc0b2110 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.286+0000 7f4f01050700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 0x7f4ee006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.287+0000 7f4f01050700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 0x7f4ee006c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80090b0 tx=0x7f4ef8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.291+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4eec053160 con 0x7f4efc0b2110 2023-08-09T14:16:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.488+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4efc06fa90 con 0x7f4efc0b2110 2023-08-09T14:16:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.490+0000 7f4ef27fc700 1 -- 172.21.15.5:0/3342975042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f4eec056780 con 0x7f4efc0b2110 2023-08-09T14:16:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:12.492 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:15:28.354900+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 msgr2=0x7f4ee006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 0x7f4ee006c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80090b0 tx=0x7f4ef8008030 comp rx=0 tx=0).stop 2023-08-09T14:16:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 msgr2=0x7f4efc0c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c480 tx=0x7f4eec00c840 comp rx=0 tx=0).stop 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 shutdown_connections 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4ee006a0e0 0x7f4ee006c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4efc15d490 0x7f4efc0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4efc0b2110 0x7f4efc0c70e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 --2- 172.21.15.5:0/3342975042 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4efc0cfe40 0x7f4efc0c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 >> 172.21.15.5:0/3342975042 conn(0x7f4efc09a180 msgr2=0x7f4efc0cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 shutdown_connections 2023-08-09T14:16:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.492+0000 7f4f03ab5700 1 -- 172.21.15.5:0/3342975042 wait complete. 2023-08-09T14:16:12.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:15:24.652455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:15:25.741922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:12.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.633+0000 7f0fd730c700 1 Processor -- start 2023-08-09T14:16:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.633+0000 7f0fd730c700 1 -- start start 2023-08-09T14:16:12.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.634+0000 7f0fd730c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 0x7f0fd00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.634+0000 7f0fd730c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.634+0000 7f0fd730c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00cb2d0 con 0x7f0fd00b2c70 2023-08-09T14:16:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.634+0000 7f0fd730c700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00cee00 con 0x7f0fd0159e90 2023-08-09T14:16:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.634+0000 7f0fd730c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00cb5b0 con 0x7f0fd00ce410 2023-08-09T14:16:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd50a8700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 0x7f0fd00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:33742/0 (socket says 172.21.15.5:33742) 2023-08-09T14:16:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 -- 172.21.15.5:0/3691008421 learned_addr learned my addr 172.21.15.5:0/3691008421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 -- 172.21.15.5:0/3691008421 >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 msgr2=0x7f0fd00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 --2- 172.21.15.5:0/3691008421 >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 0x7f0fd00cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 -- 172.21.15.5:0/3691008421 >> v1:172.21.15.101:6789/0 conn(0x7f0fd00b2c70 legacy=0x7f0fd006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 -- 172.21.15.5:0/3691008421 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00cb890 con 0x7f0fd00ce410 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd50a8700 1 --2- 172.21.15.5:0/3691008421 >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 0x7f0fd00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fd58a9700 1 --2- 172.21.15.5:0/3691008421 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d150 tx=0x7f0fc800d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd71e99f4db7d07 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fc3fff700 1 -- 172.21.15.5:0/3691008421 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8010070 con 0x7f0fd00ce410 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fc3fff700 1 -- 172.21.15.5:0/3691008421 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800dd10 con 0x7f0fd00ce410 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.635+0000 7f0fc3fff700 1 -- 172.21.15.5:0/3691008421 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800b310 con 0x7f0fd00ce410 2023-08-09T14:16:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 -- 172.21.15.5:0/3691008421 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 msgr2=0x7f0fd00ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 --2- 172.21.15.5:0/3691008421 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d150 tx=0x7f0fc800d460 comp rx=0 tx=0).stop 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 -- 172.21.15.5:0/3691008421 shutdown_connections 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 --2- 172.21.15.5:0/3691008421 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd00ce8c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 --2- 172.21.15.5:0/3691008421 >> v2:172.21.15.101:3300/0 conn(0x7f0fd0159e90 0x7f0fd00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 -- 172.21.15.5:0/3691008421 >> 172.21.15.5:0/3691008421 conn(0x7f0fd00b1970 msgr2=0x7f0fd00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 -- 172.21.15.5:0/3691008421 shutdown_connections 2023-08-09T14:16:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.636+0000 7f0fd730c700 1 -- 172.21.15.5:0/3691008421 wait complete. 2023-08-09T14:16:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.637+0000 7f0fd730c700 1 Processor -- start 2023-08-09T14:16:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.637+0000 7f0fd730c700 1 -- start start 2023-08-09T14:16:12.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0fd0159e90 0x7f0fd00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00c8f70 con 0x7f0fd00b2c70 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00adce0 con 0x7f0fd0159e90 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd730c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0154900 con 0x7f0fd00ce410 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd50a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd50a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44162/0 (socket says 172.21.15.5:44162) 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd50a8700 1 -- 172.21.15.5:0/2346964811 learned_addr learned my addr 172.21.15.5:0/2346964811 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd58a9700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0fd0159e90 0x7f0fd00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.638+0000 7f0fd48a7700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 -- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 msgr2=0x7f0fd014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd014e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 -- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0fd0159e90 msgr2=0x7f0fd00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0fd0159e90 0x7f0fd00b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 -- 172.21.15.5:0/2346964811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094a0 con 0x7f0fd00b2c70 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd50a8700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400ec10 tx=0x7f0fc400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4009760 con 0x7f0fd00b2c70 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400c850 con 0x7f0fd00b2c70 2023-08-09T14:16:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc800bd40 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400cbe0 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.639+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd00c85d0 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.640+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd0074600 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.640+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0fc400cd40 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.641+0000 7f0fc1ffb700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 0x7f0fb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.641+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fc40884d0 con 0x7f0fd00b2c70 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.641+0000 7f0fd48a7700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 0x7f0fb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.642+0000 7f0fd48a7700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 0x7f0fb406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fd01579d0 tx=0x7f0fcc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.645+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0fc4053c50 con 0x7f0fd00b2c70 2023-08-09T14:16:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.844+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0fd00d0b10 con 0x7f0fd00b2c70 2023-08-09T14:16:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.844+0000 7f0fc1ffb700 1 -- 172.21.15.5:0/2346964811 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0fc4057270 con 0x7f0fd00b2c70 2023-08-09T14:16:12.846 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 msgr2=0x7f0fb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 0x7f0fb406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fd01579d0 tx=0x7f0fcc009040 comp rx=0 tx=0).stop 2023-08-09T14:16:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 msgr2=0x7f0fd00ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400ec10 tx=0x7f0fc400ef20 comp rx=0 tx=0).stop 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 shutdown_connections 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f0fb406a0e0 0x7f0fb406c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f0fd0159e90 0x7f0fd00b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fd00b2c70 0x7f0fd00ad7a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 --2- 172.21.15.5:0/2346964811 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f0fd00ce410 0x7f0fd014e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 >> 172.21.15.5:0/2346964811 conn(0x7f0fd00b1970 msgr2=0x7f0fd00afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 shutdown_connections 2023-08-09T14:16:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.847+0000 7f0fd730c700 1 -- 172.21.15.5:0/2346964811 wait complete. 2023-08-09T14:16:12.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.987+0000 7f67308d8700 1 Processor -- start 2023-08-09T14:16:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.987+0000 7f67308d8700 1 -- start start 2023-08-09T14:16:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f67308d8700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f672c0b6170 0x7f672c15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f67308d8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 0x7f672c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f67308d8700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0cf500 con 0x7f672c0b2e20 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f67308d8700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c15fc90 con 0x7f672c0b6170 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f67308d8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0b32b0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f672a59c700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f672c0b6170 0x7f672c15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f6729d9b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 0x7f672c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f672ad9d700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7f672c0b2e20 0x7f672c151a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:38936/0 (socket says 172.21.15.5:38936) 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f672ad9d700 1 -- 172.21.15.5:0/4236534192 learned_addr learned my addr 172.21.15.5:0/4236534192 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f672959a700 1 -- 172.21.15.5:0/4236534192 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364789172 0 0) 0x7f672c0cf500 con 0x7f672c0b2e20 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f672959a700 1 -- 172.21.15.5:0/4236534192 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67140035b0 con 0x7f672c0b2e20 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f6729d9b700 1 -- 172.21.15.5:0/4236534192 >> v2:172.21.15.101:3300/0 conn(0x7f672c0b6170 msgr2=0x7f672c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f6729d9b700 1 --2- 172.21.15.5:0/4236534192 >> v2:172.21.15.101:3300/0 conn(0x7f672c0b6170 0x7f672c15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f6729d9b700 1 -- 172.21.15.5:0/4236534192 >> v1:172.21.15.101:6789/0 conn(0x7f672c0b2e20 legacy=0x7f672c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.988+0000 7f6729d9b700 1 -- 172.21.15.5:0/4236534192 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0cb910 con 0x7f672c0cb4b0 2023-08-09T14:16:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f6729d9b700 1 --2- 172.21.15.5:0/4236534192 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 0x7f672c0b28e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6720009840 tx=0x7f6720009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f045da91331e580 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f672959a700 1 -- 172.21.15.5:0/4236534192 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011830 con 0x7f672c0cb4b0 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f672959a700 1 -- 172.21.15.5:0/4236534192 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720011990 con 0x7f672c0cb4b0 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f672959a700 1 -- 172.21.15.5:0/4236534192 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011d20 con 0x7f672c0cb4b0 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 -- 172.21.15.5:0/4236534192 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 msgr2=0x7f672c0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 --2- 172.21.15.5:0/4236534192 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 0x7f672c0b28e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6720009840 tx=0x7f6720009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 -- 172.21.15.5:0/4236534192 shutdown_connections 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 --2- 172.21.15.5:0/4236534192 >> v2:172.21.15.101:3300/0 conn(0x7f672c0b6170 0x7f672c15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 --2- 172.21.15.5:0/4236534192 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0cb4b0 0x7f672c0b28e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 -- 172.21.15.5:0/4236534192 >> 172.21.15.5:0/4236534192 conn(0x7f672c06dec0 msgr2=0x7f672c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 -- 172.21.15.5:0/4236534192 shutdown_connections 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.989+0000 7f67308d8700 1 -- 172.21.15.5:0/4236534192 wait complete. 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 Processor -- start 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 -- start start 2023-08-09T14:16:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0b2e20 0x7f672c0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f672c0b6170 0x7f672c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c154540 con 0x7f672c0cb4b0 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15d440 con 0x7f672c0b6170 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.991+0000 7f67308d8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15c830 con 0x7f672c0b2e20 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44180/0 (socket says 172.21.15.5:44180) 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 -- 172.21.15.5:0/2296027019 learned_addr learned my addr 172.21.15.5:0/2296027019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672a59c700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0b2e20 0x7f672c0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f6729d9b700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f672c0b6170 0x7f672c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 -- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0b2e20 msgr2=0x7f672c0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0b2e20 0x7f672c0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 -- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f672c0b6170 msgr2=0x7f672c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f672c0b6170 0x7f672c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 -- 172.21.15.5:0/2296027019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200094a0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f672ad9d700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f672400cb40 tx=0x7f672400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400a9e0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c15cb10 con 0x7f672c0cb4b0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672400ab40 con 0x7f672c0cb4b0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724012400 con 0x7f672c0cb4b0 2023-08-09T14:16:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.992+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c15d0d0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.993+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c15d5d0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.994+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f672401b3b0 con 0x7f672c0cb4b0 2023-08-09T14:16:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.994+0000 7f671affd700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 0x7f670c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.994+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6724088140 con 0x7f672c0cb4b0 2023-08-09T14:16:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.995+0000 7f672a59c700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 0x7f670c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.995+0000 7f672a59c700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 0x7f670c06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f671c009be0 tx=0x7f671c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:12.999+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6724053860 con 0x7f672c0cb4b0 2023-08-09T14:16:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.201+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f672c15d7d0 con 0x7f672c0cb4b0 2023-08-09T14:16:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.201+0000 7f671affd700 1 -- 172.21.15.5:0/2296027019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6724056e80 con 0x7f672c0cb4b0 2023-08-09T14:16:13.203 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 msgr2=0x7f670c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 0x7f670c06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f671c009be0 tx=0x7f671c009210 comp rx=0 tx=0).stop 2023-08-09T14:16:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 msgr2=0x7f672c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f672400cb40 tx=0x7f672400ce50 comp rx=0 tx=0).stop 2023-08-09T14:16:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 shutdown_connections 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f670c06a0e0 0x7f670c06c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0cb4b0 0x7f672c0b20e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f672c0b2e20 0x7f672c0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 --2- 172.21.15.5:0/2296027019 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f672c0b6170 0x7f672c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 >> 172.21.15.5:0/2296027019 conn(0x7f672c06dec0 msgr2=0x7f672c0b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.203+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 shutdown_connections 2023-08-09T14:16:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.204+0000 7f67308d8700 1 -- 172.21.15.5:0/2296027019 wait complete. 2023-08-09T14:16:13.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:16:13.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.342+0000 7fe49902e700 1 Processor -- start 2023-08-09T14:16:13.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.342+0000 7fe49902e700 1 -- start start 2023-08-09T14:16:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49902e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4940cc650 0x7fe49406be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49902e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940b4b90 0x7fe49406a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49902e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940cd990 con 0x7fe494066160 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49902e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940b53e0 con 0x7fe4940cc650 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49902e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b5100 con 0x7fe4940b4b90 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4940cc650 0x7fe49406be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4940cc650 0x7fe49406be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44184/0 (socket says 172.21.15.5:44184) 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 -- 172.21.15.5:0/1636520607 learned_addr learned my addr 172.21.15.5:0/1636520607 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe49259c700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940b4b90 0x7fe49406a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 -- 172.21.15.5:0/1636520607 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940b4b90 msgr2=0x7fe49406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940b4b90 0x7fe49406a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 -- 172.21.15.5:0/1636520607 >> v1:172.21.15.101:6789/0 conn(0x7fe494066160 legacy=0x7fe4940ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.343+0000 7fe492d9d700 1 -- 172.21.15.5:0/1636520607 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cdbc0 con 0x7fe4940cc650 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe492d9d700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4940cc650 0x7fe49406be90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af20f5007d0b731 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe491d9b700 1 -- 172.21.15.5:0/1636520607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488005e30 con 0x7fe4940cc650 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe491d9b700 1 -- 172.21.15.5:0/1636520607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488004030 con 0x7fe4940cc650 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe491d9b700 1 -- 172.21.15.5:0/1636520607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880043e0 con 0x7fe4940cc650 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 -- 172.21.15.5:0/1636520607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4940cc650 msgr2=0x7fe49406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4940cc650 0x7fe49406be90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 -- 172.21.15.5:0/1636520607 shutdown_connections 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4940cc650 0x7fe49406be90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 --2- 172.21.15.5:0/1636520607 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940b4b90 0x7fe49406a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 -- 172.21.15.5:0/1636520607 >> 172.21.15.5:0/1636520607 conn(0x7fe4940cf4d0 msgr2=0x7fe4940cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:13.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 -- 172.21.15.5:0/1636520607 shutdown_connections 2023-08-09T14:16:13.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.344+0000 7fe49902e700 1 -- 172.21.15.5:0/1636520607 wait complete. 2023-08-09T14:16:13.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.346+0000 7fe49902e700 1 Processor -- start 2023-08-09T14:16:13.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.346+0000 7fe49902e700 1 -- start start 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe4940b4b90 0x7fe4940c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940cc650 0x7fe4940c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940aca60 con 0x7fe494066160 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415bc80 con 0x7fe4940b4b90 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49902e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415f580 con 0x7fe4940cc650 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44190/0 (socket says 172.21.15.5:44190) 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 -- 172.21.15.5:0/2141931159 learned_addr learned my addr 172.21.15.5:0/2141931159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49359e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940cc650 0x7fe4940c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe49259c700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe4940b4b90 0x7fe4940c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 -- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940cc650 msgr2=0x7fe4940c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940cc650 0x7fe4940c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 -- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe4940b4b90 msgr2=0x7fe4940c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe4940b4b90 0x7fe4940c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 -- 172.21.15.5:0/2141931159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488009500 con 0x7fe494066160 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe492d9d700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe488009c10 tx=0x7fe488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.347+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488003e10 con 0x7fe494066160 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.348+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488011420 con 0x7fe494066160 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.348+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880117d0 con 0x7fe494066160 2023-08-09T14:16:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.348+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49415ea00 con 0x7fe494066160 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.348+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49415efc0 con 0x7fe494066160 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.349+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4940b2240 con 0x7fe494066160 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.349+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe488011930 con 0x7fe494066160 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.349+0000 7fe47b7fe700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 0x7fe48006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.349+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe488089780 con 0x7fe494066160 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.349+0000 7fe49259c700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 0x7fe48006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.350+0000 7fe49259c700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 0x7fe48006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4940b1970 tx=0x7fe484008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.354+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe488054f00 con 0x7fe494066160 2023-08-09T14:16:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.550+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe494074600 con 0x7fe494066160 2023-08-09T14:16:13.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.550+0000 7fe47b7fe700 1 -- 172.21.15.5:0/2141931159 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe488058520 con 0x7fe494066160 2023-08-09T14:16:13.553 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:16:13.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.552+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 msgr2=0x7fe48006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.552+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 0x7fe48006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4940b1970 tx=0x7fe484008040 comp rx=0 tx=0).stop 2023-08-09T14:16:13.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 msgr2=0x7fe49415b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe488009c10 tx=0x7fe488004750 comp rx=0 tx=0).stop 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 shutdown_connections 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fe48006a0e0 0x7fe48006c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fe4940cc650 0x7fe4940c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe494066160 0x7fe49415b740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 --2- 172.21.15.5:0/2141931159 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fe4940b4b90 0x7fe4940c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 >> 172.21.15.5:0/2141931159 conn(0x7fe4940cf4d0 msgr2=0x7fe4940aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 shutdown_connections 2023-08-09T14:16:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.553+0000 7fe49902e700 1 -- 172.21.15.5:0/2141931159 wait complete. 2023-08-09T14:16:13.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:16:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.692+0000 7fb2c1b8a700 1 Processor -- start 2023-08-09T14:16:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.692+0000 7fb2c1b8a700 1 -- start start 2023-08-09T14:16:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2c1b8a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2bc15b280 0x7fb2bc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2c1b8a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc15b660 0x7fb2bc0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2c1b8a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0b4180 con 0x7fb2bc0cfff0 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2c1b8a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc0b53f0 con 0x7fb2bc15b280 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2c1b8a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc066300 con 0x7fb2bc15b660 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2bb7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2bc15b280 0x7fb2bc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2bbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2bc0cfff0 0x7fb2bc0cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57616/0 (socket says 172.21.15.5:57616) 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2bbfff700 1 -- 172.21.15.5:0/4144968044 learned_addr learned my addr 172.21.15.5:0/4144968044 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.693+0000 7fb2baffd700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc15b660 0x7fb2bc0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2bb7fe700 1 -- 172.21.15.5:0/4144968044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc15b660 msgr2=0x7fb2bc0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2bb7fe700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc15b660 0x7fb2bc0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2bb7fe700 1 -- 172.21.15.5:0/4144968044 >> v1:172.21.15.5:6789/0 conn(0x7fb2bc0cfff0 legacy=0x7fb2bc0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2bb7fe700 1 -- 172.21.15.5:0/4144968044 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0b43d0 con 0x7fb2bc15b280 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2ba7fc700 1 -- 172.21.15.5:0/4144968044 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814402996 0 0) 0x7fb2bc0b4180 con 0x7fb2bc0cfff0 2023-08-09T14:16:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2bb7fe700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b280 0x7fb2bc0b4eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009820 tx=0x7fb2a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac63b0bcd8448ba7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2ba7fc700 1 -- 172.21.15.5:0/4144968044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005e30 con 0x7fb2bc15b280 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2ba7fc700 1 -- 172.21.15.5:0/4144968044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4006030 con 0x7fb2bc15b280 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2ba7fc700 1 -- 172.21.15.5:0/4144968044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40063e0 con 0x7fb2bc15b280 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/4144968044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b280 msgr2=0x7fb2bc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.694+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b280 0x7fb2bc0b4eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009820 tx=0x7fb2a4009b30 comp rx=0 tx=0).stop 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/4144968044 shutdown_connections 2023-08-09T14:16:13.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b280 0x7fb2bc0b4eb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/4144968044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc15b660 0x7fb2bc0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/4144968044 >> 172.21.15.5:0/4144968044 conn(0x7fb2bc0cf4d0 msgr2=0x7fb2bc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:13.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/4144968044 shutdown_connections 2023-08-09T14:16:13.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.695+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/4144968044 wait complete. 2023-08-09T14:16:13.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.696+0000 7fb2c1b8a700 1 Processor -- start 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.696+0000 7fb2c1b8a700 1 -- start start 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc0cfff0 0x7fb2bc154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 0x7fb2bc159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ae280 con 0x7fb2bc15b660 2023-08-09T14:16:13.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ae980 con 0x7fb2bc15b280 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2c1b8a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0af590 con 0x7fb2bc0cfff0 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44204/0 (socket says 172.21.15.5:44204) 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 -- 172.21.15.5:0/2904075162 learned_addr learned my addr 172.21.15.5:0/2904075162 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2baffd700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 0x7fb2bc159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bb7fe700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc0cfff0 0x7fb2bc154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 -- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc0cfff0 msgr2=0x7fb2bc154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc0cfff0 0x7fb2bc154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 -- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 msgr2=0x7fb2bc159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 0x7fb2bc159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 -- 172.21.15.5:0/2904075162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009430 con 0x7fb2bc15b660 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2baffd700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 0x7fb2bc159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.697+0000 7fb2bbfff700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400cbd0 tx=0x7fb2b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400aab0 con 0x7fb2bc15b660 2023-08-09T14:16:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400ac30 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc06de00 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40070d0 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc0af2b0 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.698+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc074600 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.699+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2b4007230 con 0x7fb2bc15b660 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.699+0000 7fb2b3fff700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 0x7fb29c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.700+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2b40882b0 con 0x7fb2bc15b660 2023-08-09T14:16:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.700+0000 7fb2bb7fe700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 0x7fb29c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.700+0000 7fb2bb7fe700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 0x7fb29c06c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4013040 tx=0x7fb2a4008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.704+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb2b40539a0 con 0x7fb2bc15b660 2023-08-09T14:16:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.904+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2bc0ccb20 con 0x7fb2bc15b660 2023-08-09T14:16:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.904+0000 7fb2b3fff700 1 -- 172.21.15.5:0/2904075162 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2b4056fc0 con 0x7fb2bc15b660 2023-08-09T14:16:13.907 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:16:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.906+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 msgr2=0x7fb29c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.906+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 0x7fb29c06c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4013040 tx=0x7fb2a4008070 comp rx=0 tx=0).stop 2023-08-09T14:16:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 msgr2=0x7fb2bc15a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400cbd0 tx=0x7fb2b400cf90 comp rx=0 tx=0).stop 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 shutdown_connections 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb29c06a0e0 0x7fb29c06c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc15b660 0x7fb2bc15a060 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2bc0cfff0 0x7fb2bc154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 --2- 172.21.15.5:0/2904075162 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2bc15b280 0x7fb2bc159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 >> 172.21.15.5:0/2904075162 conn(0x7fb2bc0cf4d0 msgr2=0x7fb2bc0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 shutdown_connections 2023-08-09T14:16:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:13.907+0000 7fb2c1b8a700 1 -- 172.21.15.5:0/2904075162 wait complete. 2023-08-09T14:16:13.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.045+0000 7ff09605c700 1 Processor -- start 2023-08-09T14:16:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.045+0000 7ff09605c700 1 -- start start 2023-08-09T14:16:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff09605c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff0901682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff09605c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900d0760 con 0x7ff0900b2130 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff09605c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900ce7f0 con 0x7ff09015d5d0 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff09605c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900b00d0 con 0x7ff0900b1500 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff08effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff0900b2130 0x7ff0900d16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57630/0 (socket says 172.21.15.5:57630) 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff08effd700 1 -- 172.21.15.5:0/3481417912 learned_addr learned my addr 172.21.15.5:0/3481417912 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435236210 0 0) 0x7ff0900d0760 con 0x7ff0900b2130 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff08ffff700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff0901682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.046+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0780035b0 con 0x7ff0900b2130 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108708874 0 0) 0x7ff0780035b0 con 0x7ff0900b2130 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 msgr2=0x7ff0901682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff0901682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 >> v1:172.21.15.101:6789/0 conn(0x7ff09015d5d0 legacy=0x7ff0900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900afd60 con 0x7ff0900b2130 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7ff084001670 con 0x7ff0900b2130 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 >> v1:172.21.15.5:6789/0 conn(0x7ff0900b2130 legacy=0x7ff0900d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff078003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003fb0 0x7ff078004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff078004d90 0x7ff078005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900b00d0 con 0x7ff078003fb0 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07800baf0 con 0x7ff078004d90 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07800bcb0 con 0x7ff0900b1500 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003fb0 0x7ff078004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08f7fe700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff078003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08ffff700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff078004d90 0x7ff078005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 -- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 msgr2=0x7ff078003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff0900b1500 0x7ff078003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 -- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff078004d90 msgr2=0x7ff078005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff078004d90 0x7ff078005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 -- 172.21.15.5:0/3481417912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780035b0 con 0x7ff078003fb0 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.047+0000 7ff08effd700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003fb0 0x7ff078004850 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c210 tx=0x7ff078005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324718bd6a36d626 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084007c10 con 0x7ff078003fb0 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400cdd0 con 0x7ff078003fb0 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff08e7fc700 1 -- 172.21.15.5:0/3481417912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084005ba0 con 0x7ff078003fb0 2023-08-09T14:16:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 -- 172.21.15.5:0/3481417912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003fb0 msgr2=0x7ff078004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 --2- 172.21.15.5:0/3481417912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003fb0 0x7ff078004850 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c210 tx=0x7ff078005880 comp rx=0 tx=0).stop 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff08ffff700 1 -- 172.21.15.5:0/3481417912 reap_dead start 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 -- 172.21.15.5:0/3481417912 shutdown_connections 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 -- 172.21.15.5:0/3481417912 >> 172.21.15.5:0/3481417912 conn(0x7ff0900d3090 msgr2=0x7ff0900d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 -- 172.21.15.5:0/3481417912 shutdown_connections 2023-08-09T14:16:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.048+0000 7ff09605c700 1 -- 172.21.15.5:0/3481417912 wait complete. 2023-08-09T14:16:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.050+0000 7ff09605c700 1 Processor -- start 2023-08-09T14:16:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.050+0000 7ff09605c700 1 -- start start 2023-08-09T14:16:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff078003fb0 0x7ff090152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff0900b7cc0 0x7ff0900b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901f2f80 con 0x7ff0901f6770 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900b8680 con 0x7ff0900b7cc0 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff09605c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901f74e0 con 0x7ff078003fb0 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44226/0 (socket says 172.21.15.5:44226) 2023-08-09T14:16:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 -- 172.21.15.5:0/1724606708 learned_addr learned my addr 172.21.15.5:0/1724606708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08f7fe700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff078003fb0 0x7ff090152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08effd700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff0900b7cc0 0x7ff0900b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 -- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff078003fb0 msgr2=0x7ff090152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff078003fb0 0x7ff090152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 -- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff0900b7cc0 msgr2=0x7ff0900b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff0900b7cc0 0x7ff0900b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 -- 172.21.15.5:0/1724606708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090152a60 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff08ffff700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff09008c490 tx=0x7ff088011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.051+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800e040 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.052+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800f040 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.052+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800fc10 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.052+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0901f3f20 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.052+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0901f3440 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.053+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff090074600 con 0x7ff0901f6770 2023-08-09T14:16:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.053+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff08800fd70 con 0x7ff0901f6770 2023-08-09T14:16:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.054+0000 7ff077fff700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 0x7ff07c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.054+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0880889e0 con 0x7ff0901f6770 2023-08-09T14:16:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.054+0000 7ff08f7fe700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 0x7ff07c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.054+0000 7ff08f7fe700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 0x7ff07c06c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cfbc0 tx=0x7ff080009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.058+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff088057b60 con 0x7ff0901f6770 2023-08-09T14:16:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.310+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0900b5970 con 0x7ff0901f6770 2023-08-09T14:16:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.310+0000 7ff077fff700 1 -- 172.21.15.5:0/1724606708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7ff0880576f0 con 0x7ff0901f6770 2023-08-09T14:16:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:14.313 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 msgr2=0x7ff07c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 0x7ff07c06c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cfbc0 tx=0x7ff080009040 comp rx=0 tx=0).stop 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 msgr2=0x7ff0901f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff09008c490 tx=0x7ff088011ed0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 shutdown_connections 2023-08-09T14:16:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff07c06a0e0 0x7ff07c06c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0901f6770 0x7ff0901f6bf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff078003fb0 0x7ff090152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 --2- 172.21.15.5:0/1724606708 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff0900b7cc0 0x7ff0900b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.312+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 >> 172.21.15.5:0/1724606708 conn(0x7ff0900d3090 msgr2=0x7ff09006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.313+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 shutdown_connections 2023-08-09T14:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.313+0000 7ff09605c700 1 -- 172.21.15.5:0/1724606708 wait complete. 2023-08-09T14:16:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:16:14.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.452+0000 7f6f6836a700 1 Processor -- start 2023-08-09T14:16:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.452+0000 7f6f6836a700 1 -- start start 2023-08-09T14:16:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.453+0000 7f6f6836a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f60154600 0x7f6f6015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.453+0000 7f6f6836a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6015eb20 con 0x7f6f6015b360 2023-08-09T14:16:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.453+0000 7f6f6836a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6015e2d0 con 0x7f6f600ce410 2023-08-09T14:16:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.453+0000 7f6f6836a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6006d4f0 con 0x7f6f60154600 2023-08-09T14:16:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.453+0000 7f6f65905700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f6015b360 0x7f6f6015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57646/0 (socket says 172.21.15.5:57646) 2023-08-09T14:16:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65905700 1 -- 172.21.15.5:0/1022150921 learned_addr learned my addr 172.21.15.5:0/1022150921 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f66106700 1 --2- 172.21.15.5:0/1022150921 >> v2:172.21.15.101:3300/0 conn(0x7f6f60154600 0x7f6f6015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436132237 0 0) 0x7f6f6015eb20 con 0x7f6f6015b360 2023-08-09T14:16:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f4c0035b0 con 0x7f6f6015b360 2023-08-09T14:16:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3241796382 0 0) 0x7f6f4c0035b0 con 0x7f6f6015b360 2023-08-09T14:16:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 >> v2:172.21.15.101:3300/0 conn(0x7f6f60154600 msgr2=0x7f6f6015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 --2- 172.21.15.5:0/1022150921 >> v2:172.21.15.101:3300/0 conn(0x7f6f60154600 0x7f6f6015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 >> v1:172.21.15.101:6789/0 conn(0x7f6f600ce410 legacy=0x7f6f6006dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6015e560 con 0x7f6f6015b360 2023-08-09T14:16:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f6f5c001670 con 0x7f6f6015b360 2023-08-09T14:16:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 >> v1:172.21.15.5:6789/0 conn(0x7f6f6015b360 legacy=0x7f6f6015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 0x7f6f4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c004850 0x7f6f4c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4c005210 0x7f6f4c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6006d4f0 con 0x7f6f4c003a00 2023-08-09T14:16:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c00c1b0 con 0x7f6f4c005210 2023-08-09T14:16:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c00c370 con 0x7f6f4c004850 2023-08-09T14:16:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f66106700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 0x7f6f4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f66907700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4c005210 0x7f6f4c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.454+0000 7f6f65905700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c004850 0x7f6f4c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 -- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c004850 msgr2=0x7f6f4c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c004850 0x7f6f4c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 -- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4c005210 msgr2=0x7f6f4c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f4c005210 0x7f6f4c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 -- 172.21.15.5:0/1022150921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0035b0 con 0x7f6f4c003a00 2023-08-09T14:16:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66907700 1 -- 172.21.15.5:0/1022150921 reap_dead start 2023-08-09T14:16:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f66106700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 0x7f6f4c003e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009b60 tx=0x7f6f4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b777fdc96f904221 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400e6c0 con 0x7f6f4c003a00 2023-08-09T14:16:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5400e820 con 0x7f6f4c003a00 2023-08-09T14:16:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f65104700 1 -- 172.21.15.5:0/1022150921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400eb90 con 0x7f6f4c003a00 2023-08-09T14:16:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f6836a700 1 -- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 msgr2=0x7f6f4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f6836a700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 0x7f6f4c003e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009b60 tx=0x7f6f4c005880 comp rx=0 tx=0).stop 2023-08-09T14:16:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f6836a700 1 -- 172.21.15.5:0/1022150921 shutdown_connections 2023-08-09T14:16:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f6836a700 1 --2- 172.21.15.5:0/1022150921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c003a00 0x7f6f4c003e20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.455+0000 7f6f6836a700 1 -- 172.21.15.5:0/1022150921 >> 172.21.15.5:0/1022150921 conn(0x7f6f600b1900 msgr2=0x7f6f600b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.456+0000 7f6f6836a700 1 -- 172.21.15.5:0/1022150921 shutdown_connections 2023-08-09T14:16:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.456+0000 7f6f6836a700 1 -- 172.21.15.5:0/1022150921 wait complete. 2023-08-09T14:16:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.457+0000 7f6f6836a700 1 Processor -- start 2023-08-09T14:16:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.457+0000 7f6f6836a700 1 -- start start 2023-08-09T14:16:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c003a00 0x7f6f601587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 0x7f6f60155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60158f40 con 0x7f6f60157700 2023-08-09T14:16:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601555b0 con 0x7f6f60154bf0 2023-08-09T14:16:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60158d20 con 0x7f6f4c003a00 2023-08-09T14:16:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44244/0 (socket says 172.21.15.5:44244) 2023-08-09T14:16:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 -- 172.21.15.5:0/3088299961 learned_addr learned my addr 172.21.15.5:0/3088299961 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f66106700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c003a00 0x7f6f601587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f66907700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 0x7f6f60155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 -- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c003a00 msgr2=0x7f6f601587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c003a00 0x7f6f601587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 -- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 msgr2=0x7f6f60155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 0x7f6f60155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 -- 172.21.15.5:0/3088299961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600c90b0 con 0x7f6f60157700 2023-08-09T14:16:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f66907700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 0x7f6f60155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f65905700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007290 tx=0x7f6f5c0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00f5e0 con 0x7f6f60157700 2023-08-09T14:16:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00f740 con 0x7f6f60157700 2023-08-09T14:16:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f600c9390 con 0x7f6f60157700 2023-08-09T14:16:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00fab0 con 0x7f6f60157700 2023-08-09T14:16:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.458+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f60159190 con 0x7f6f60157700 2023-08-09T14:16:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.459+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60074600 con 0x7f6f60157700 2023-08-09T14:16:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.460+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f5c00fc10 con 0x7f6f60157700 2023-08-09T14:16:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.460+0000 7f6f52ffd700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 0x7f6f4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.460+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6f5c088510 con 0x7f6f60157700 2023-08-09T14:16:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.460+0000 7f6f66106700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 0x7f6f4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.461+0000 7f6f66106700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 0x7f6f4406c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f540090b0 tx=0x7f6f5401e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.464+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f5c053bc0 con 0x7f6f60157700 2023-08-09T14:16:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.667+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6015bb90 con 0x7f6f60157700 2023-08-09T14:16:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.668+0000 7f6f52ffd700 1 -- 172.21.15.5:0/3088299961 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f6f5c0571e0 con 0x7f6f60157700 2023-08-09T14:16:14.671 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:14.671 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:14.108831+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 msgr2=0x7f6f4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 0x7f6f4406c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f540090b0 tx=0x7f6f5401e040 comp rx=0 tx=0).stop 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 msgr2=0x7f6f60156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007290 tx=0x7f6f5c0075a0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 shutdown_connections 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f4406a0e0 0x7f6f4406c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f60154bf0 0x7f6f60155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f4c003a00 0x7f6f601587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 --2- 172.21.15.5:0/3088299961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f60157700 0x7f6f60156d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 >> 172.21.15.5:0/3088299961 conn(0x7f6f600b1900 msgr2=0x7f6f6014ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 shutdown_connections 2023-08-09T14:16:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.670+0000 7f6f6836a700 1 -- 172.21.15.5:0/3088299961 wait complete. 2023-08-09T14:16:14.685 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T14:16:14.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.808+0000 7f9652c64700 1 Processor -- start 2023-08-09T14:16:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.808+0000 7f9652c64700 1 -- start start 2023-08-09T14:16:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9652c64700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c06a1c0 0x7f964c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9652c64700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f964c0cc780 0x7f964c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9652c64700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0ce050 con 0x7f964c15d400 2023-08-09T14:16:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9652c64700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c06ab80 con 0x7f964c0cc780 2023-08-09T14:16:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9652c64700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c06e850 con 0x7f964c06a1c0 2023-08-09T14:16:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9650a00700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f964c15d400 0x7f964c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57666/0 (socket says 172.21.15.5:57666) 2023-08-09T14:16:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9650a00700 1 -- 172.21.15.5:0/1098247452 learned_addr learned my addr 172.21.15.5:0/1098247452 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f964bfff700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c06a1c0 0x7f964c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.809+0000 7f9651201700 1 --2- 172.21.15.5:0/1098247452 >> v2:172.21.15.5:3300/0 conn(0x7f964c0cc780 0x7f964c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f964b7fe700 1 -- 172.21.15.5:0/1098247452 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501473626 0 0) 0x7f964c0ce050 con 0x7f964c15d400 2023-08-09T14:16:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f964b7fe700 1 -- 172.21.15.5:0/1098247452 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c0035b0 con 0x7f964c15d400 2023-08-09T14:16:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f9651201700 1 -- 172.21.15.5:0/1098247452 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c06a1c0 msgr2=0x7f964c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f9651201700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c06a1c0 0x7f964c06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f9651201700 1 -- 172.21.15.5:0/1098247452 >> v1:172.21.15.5:6789/0 conn(0x7f964c15d400 legacy=0x7f964c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f9651201700 1 -- 172.21.15.5:0/1098247452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0cf7b0 con 0x7f964c0cc780 2023-08-09T14:16:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f9651201700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c0cc780 0x7f964c0ccc10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9644009dc0 tx=0x7f964400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9813025baff2f0d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f964b7fe700 1 -- 172.21.15.5:0/1098247452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400e070 con 0x7f964c0cc780 2023-08-09T14:16:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f964b7fe700 1 -- 172.21.15.5:0/1098247452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400bae0 con 0x7f964c0cc780 2023-08-09T14:16:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.810+0000 7f964b7fe700 1 -- 172.21.15.5:0/1098247452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400be50 con 0x7f964c0cc780 2023-08-09T14:16:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 -- 172.21.15.5:0/1098247452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c0cc780 msgr2=0x7f964c0ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c0cc780 0x7f964c0ccc10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9644009dc0 tx=0x7f964400b330 comp rx=0 tx=0).stop 2023-08-09T14:16:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 -- 172.21.15.5:0/1098247452 shutdown_connections 2023-08-09T14:16:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c0cc780 0x7f964c0ccc10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 --2- 172.21.15.5:0/1098247452 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c06a1c0 0x7f964c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 -- 172.21.15.5:0/1098247452 >> 172.21.15.5:0/1098247452 conn(0x7f964c0b1900 msgr2=0x7f964c0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 -- 172.21.15.5:0/1098247452 shutdown_connections 2023-08-09T14:16:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.811+0000 7f9652c64700 1 -- 172.21.15.5:0/1098247452 wait complete. 2023-08-09T14:16:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.812+0000 7f9652c64700 1 Processor -- start 2023-08-09T14:16:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.812+0000 7f9652c64700 1 -- start start 2023-08-09T14:16:14.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 0x7f964c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 0x7f964c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0c35b0 con 0x7f964c15d400 2023-08-09T14:16:14.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0c3850 con 0x7f964c06a1c0 2023-08-09T14:16:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9652c64700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c1f34a0 con 0x7f964c0cc780 2023-08-09T14:16:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44260/0 (socket says 172.21.15.5:44260) 2023-08-09T14:16:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 -- 172.21.15.5:0/4285228682 learned_addr learned my addr 172.21.15.5:0/4285228682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9650a00700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 0x7f964c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f964bfff700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 0x7f964c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 -- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 msgr2=0x7f964c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 0x7f964c15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 -- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 msgr2=0x7f964c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 0x7f964c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 -- 172.21.15.5:0/4285228682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009a70 con 0x7f964c15d400 2023-08-09T14:16:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f964bfff700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 0x7f964c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9650a00700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 0x7f964c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.813+0000 7f9651201700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f964400d010 tx=0x7f9644004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644004450 con 0x7f964c15d400 2023-08-09T14:16:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964401f070 con 0x7f964c15d400 2023-08-09T14:16:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c1f3780 con 0x7f964c15d400 2023-08-09T14:16:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644004810 con 0x7f964c15d400 2023-08-09T14:16:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c1f3190 con 0x7f964c15d400 2023-08-09T14:16:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.814+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c074600 con 0x7f964c15d400 2023-08-09T14:16:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.816+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9644012430 con 0x7f964c15d400 2023-08-09T14:16:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.816+0000 7f96497fa700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 0x7f963006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.816+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9644089760 con 0x7f964c15d400 2023-08-09T14:16:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.816+0000 7f9650a00700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 0x7f963006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.817+0000 7f9650a00700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 0x7f963006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9640005910 tx=0x7f9640009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:14.820+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9644054f80 con 0x7f964c15d400 2023-08-09T14:16:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.065+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f964c071f30 con 0x7f964c15d400 2023-08-09T14:16:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.066+0000 7f96497fa700 1 -- 172.21.15.5:0/4285228682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7f96440585a0 con 0x7f964c15d400 2023-08-09T14:16:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:15.068 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:16:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 msgr2=0x7f963006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 0x7f963006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9640005910 tx=0x7f9640009040 comp rx=0 tx=0).stop 2023-08-09T14:16:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 msgr2=0x7f964c158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f964400d010 tx=0x7f9644004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 shutdown_connections 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f963006a0e0 0x7f963006c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964c15d400 0x7f964c158a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f964c06a1c0 0x7f964c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 --2- 172.21.15.5:0/4285228682 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f964c0cc780 0x7f964c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 >> 172.21.15.5:0/4285228682 conn(0x7f964c0b1900 msgr2=0x7f964c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 shutdown_connections 2023-08-09T14:16:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.068+0000 7f9652c64700 1 -- 172.21.15.5:0/4285228682 wait complete. 2023-08-09T14:16:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:16:15.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:15.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.207+0000 7f17191ce700 1 Processor -- start 2023-08-09T14:16:15.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.207+0000 7f17191ce700 1 -- start start 2023-08-09T14:16:15.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f17191ce700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f1714071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f17191ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f171406a1c0 0x7f171406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f17191ce700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17140716b0 con 0x7f17140cc730 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f17191ce700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171406eb60 con 0x7f171406a1c0 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f17191ce700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171406ab80 con 0x7f171415b020 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f171406a1c0 0x7f171406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f171406a1c0 0x7f171406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44264/0 (socket says 172.21.15.5:44264) 2023-08-09T14:16:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 -- 172.21.15.5:0/72318442 learned_addr learned my addr 172.21.15.5:0/72318442 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f1712d9d700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f1714071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 -- 172.21.15.5:0/72318442 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 msgr2=0x7f1714071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f1714071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 -- 172.21.15.5:0/72318442 >> v1:172.21.15.101:6789/0 conn(0x7f17140cc730 legacy=0x7f17140ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 -- 172.21.15.5:0/72318442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171406e4c0 con 0x7f171406a1c0 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f171259c700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f171406a1c0 0x7f171406a640 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17080098f0 tx=0x7f1708009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24254e638a1e64b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f1711d9b700 1 -- 172.21.15.5:0/72318442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800b8a0 con 0x7f171406a1c0 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f1711d9b700 1 -- 172.21.15.5:0/72318442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800ba00 con 0x7f171406a1c0 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.208+0000 7f1711d9b700 1 -- 172.21.15.5:0/72318442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800bd90 con 0x7f171406a1c0 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 -- 172.21.15.5:0/72318442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f171406a1c0 msgr2=0x7f171406a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f171406a1c0 0x7f171406a640 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17080098f0 tx=0x7f1708009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 -- 172.21.15.5:0/72318442 shutdown_connections 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f1714071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 --2- 172.21.15.5:0/72318442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f171406a1c0 0x7f171406a640 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 -- 172.21.15.5:0/72318442 >> 172.21.15.5:0/72318442 conn(0x7f17140b1900 msgr2=0x7f17140b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 -- 172.21.15.5:0/72318442 shutdown_connections 2023-08-09T14:16:15.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.209+0000 7f17191ce700 1 -- 172.21.15.5:0/72318442 wait complete. 2023-08-09T14:16:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.210+0000 7f17191ce700 1 Processor -- start 2023-08-09T14:16:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 -- start start 2023-08-09T14:16:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f171406a1c0 0x7f17140cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f17140cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714157bc0 con 0x7f17140cc730 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17140ce300 con 0x7f171406a1c0 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f17191ce700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140ce5e0 con 0x7f171415b020 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f171259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f171259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44272/0 (socket says 172.21.15.5:44272) 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f171259c700 1 -- 172.21.15.5:0/4010651044 learned_addr learned my addr 172.21.15.5:0/4010651044 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.211+0000 7f1712d9d700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f171406a1c0 0x7f17140cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171359e700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f17140cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 -- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 msgr2=0x7f17140cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f17140cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 -- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f171406a1c0 msgr2=0x7f17140cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f171406a1c0 0x7f17140cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 -- 172.21.15.5:0/4010651044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009550 con 0x7f17140cc730 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f171259c700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1708009c40 tx=0x7f1708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708004300 con 0x7f17140cc730 2023-08-09T14:16:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170801f070 con 0x7f17140cc730 2023-08-09T14:16:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17140c54a0 con 0x7f17140cc730 2023-08-09T14:16:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17080036a0 con 0x7f17140cc730 2023-08-09T14:16:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.212+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17140ce8c0 con 0x7f17140cc730 2023-08-09T14:16:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.213+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17140c5300 con 0x7f17140cc730 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.213+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1708021030 con 0x7f17140cc730 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.214+0000 7f16fb7fe700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 0x7f170006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.214+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1708089820 con 0x7f17140cc730 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.214+0000 7f1712d9d700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 0x7f170006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.215+0000 7f1712d9d700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 0x7f170006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1704006b20 tx=0x7f1704008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.218+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f17140c5300 con 0x7f17140cc730 2023-08-09T14:16:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.468+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17140c59c0 con 0x7f17140cc730 2023-08-09T14:16:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.469+0000 7f16fb7fe700 1 -- 172.21.15.5:0/4010651044 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4866 (secure 0 0 0) 0x7f17140c59c0 con 0x7f17140cc730 2023-08-09T14:16:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:15.472 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/3347643135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6836","nonce":3347643135},{"type":"v1","addr":"172.21.15.101:6837","nonce":3347643135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/997741540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":997741540},{"type":"v1","addr":"172.21.15.5:6835","nonce":997741540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3732100851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3732100851},{"type":"v1","addr":"172.21.15.5:6833","nonce":3732100851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:15:26.772406+0000","modified":"2023-08-09T14:15:30.369218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.101:6835/4162053601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":4162053601},{"type":"v1","addr":"172.21.15.101:6835","nonce":4162053601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T14:16:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 msgr2=0x7f170006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 0x7f170006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1704006b20 tx=0x7f1704008040 comp rx=0 tx=0).stop 2023-08-09T14:16:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 msgr2=0x7f17140ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1708009c40 tx=0x7f1708004750 comp rx=0 tx=0).stop 2023-08-09T14:16:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 shutdown_connections 2023-08-09T14:16:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f170006a0e0 0x7f170006c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f171415b020 0x7f17140cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f171406a1c0 0x7f17140cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 --2- 172.21.15.5:0/4010651044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17140cc730 0x7f17140ccb10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 >> 172.21.15.5:0/4010651044 conn(0x7f17140b1900 msgr2=0x7f17140c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 shutdown_connections 2023-08-09T14:16:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.471+0000 7f17191ce700 1 -- 172.21.15.5:0/4010651044 wait complete. 2023-08-09T14:16:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-08-09T14:16:15.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.608+0000 7fb616c2a700 1 Processor -- start 2023-08-09T14:16:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.608+0000 7fb616c2a700 1 -- start start 2023-08-09T14:16:15.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb616c2a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb61015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb616c2a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fb6100ce410 0x7fb6100ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb616c2a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100cede0 con 0x7fb61015b360 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb616c2a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61015eb20 con 0x7fb6100ce410 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb616c2a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015e2d0 con 0x7fb610154600 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb60ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb61015b360 0x7fb61015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57694/0 (socket says 172.21.15.5:57694) 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb60ffff700 1 -- 172.21.15.5:0/4291244804 learned_addr learned my addr 172.21.15.5:0/4291244804 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb6151c7700 1 --2- 172.21.15.5:0/4291244804 >> v2:172.21.15.101:3300/0 conn(0x7fb6100ce410 0x7fb6100ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666218668 0 0) 0x7fb6100cede0 con 0x7fb61015b360 2023-08-09T14:16:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb6149c6700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb61015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.609+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6000035b0 con 0x7fb61015b360 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2733579991 0 0) 0x7fb6000035b0 con 0x7fb61015b360 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 msgr2=0x7fb61015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb61015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 >> v2:172.21.15.101:3300/0 conn(0x7fb6100ce410 msgr2=0x7fb6100ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 --2- 172.21.15.5:0/4291244804 >> v2:172.21.15.101:3300/0 conn(0x7fb6100ce410 0x7fb6100ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61006d4f0 con 0x7fb61015b360 2023-08-09T14:16:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fb5fc001670 con 0x7fb61015b360 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 >> v1:172.21.15.5:6789/0 conn(0x7fb61015b360 legacy=0x7fb61015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb600003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb600004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb600004d90 0x7fb600005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015eb20 con 0x7fb600003f80 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015e2d0 con 0x7fb600004d90 2023-08-09T14:16:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60000dc70 con 0x7fb610154600 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb600004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb6149c6700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb600003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb6151c7700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb600004d90 0x7fb600005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 -- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 msgr2=0x7fb600003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610154600 0x7fb600003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 -- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb600004d90 msgr2=0x7fb600005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb600004d90 0x7fb600005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 -- 172.21.15.5:0/4291244804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6000035b0 con 0x7fb600003f80 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb6151c7700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb600004d90 0x7fb600005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.610+0000 7fb60ffff700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb600004850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c2f0 tx=0x7fb600005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a14eb23de611977 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00cdf0 con 0x7fb600003f80 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc005960 con 0x7fb600003f80 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb60f7fe700 1 -- 172.21.15.5:0/4291244804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc005d10 con 0x7fb600003f80 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 -- 172.21.15.5:0/4291244804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 msgr2=0x7fb600004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 --2- 172.21.15.5:0/4291244804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb600004850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c2f0 tx=0x7fb600005880 comp rx=0 tx=0).stop 2023-08-09T14:16:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb6151c7700 1 -- 172.21.15.5:0/4291244804 reap_dead start 2023-08-09T14:16:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 -- 172.21.15.5:0/4291244804 shutdown_connections 2023-08-09T14:16:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 -- 172.21.15.5:0/4291244804 >> 172.21.15.5:0/4291244804 conn(0x7fb6100b1900 msgr2=0x7fb6100b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 -- 172.21.15.5:0/4291244804 shutdown_connections 2023-08-09T14:16:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.611+0000 7fb616c2a700 1 -- 172.21.15.5:0/4291244804 wait complete. 2023-08-09T14:16:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.612+0000 7fb616c2a700 1 Processor -- start 2023-08-09T14:16:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 -- start start 2023-08-09T14:16:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610157710 0x7fb6101581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb610158730 0x7fb61015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61014cd70 con 0x7fb600003f80 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610158be0 con 0x7fb610158730 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb616c2a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61014c0f0 con 0x7fb610157710 2023-08-09T14:16:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb6149c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.613+0000 7fb6149c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44290/0 (socket says 172.21.15.5:44290) 2023-08-09T14:16:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 -- 172.21.15.5:0/3124470514 learned_addr learned my addr 172.21.15.5:0/3124470514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6151c7700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb610158730 0x7fb61015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb60ffff700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610157710 0x7fb6101581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 -- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610157710 msgr2=0x7fb6101581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610157710 0x7fb6101581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 -- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb610158730 msgr2=0x7fb61015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb610158730 0x7fb61015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 -- 172.21.15.5:0/3124470514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61014c3d0 con 0x7fb600003f80 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb6149c6700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb604011aa0 tx=0x7fb604011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400f980 con 0x7fb600003f80 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60400fae0 con 0x7fb600003f80 2023-08-09T14:16:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61014c6b0 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400fe90 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.614+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61014d190 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.615+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61014d3b0 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.616+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb604014440 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.616+0000 7fb60d7fa700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.616+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb604088c00 con 0x7fb600003f80 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.616+0000 7fb60ffff700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.617+0000 7fb60ffff700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6101539d0 tx=0x7fb5fc00a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.620+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb60408f080 con 0x7fb600003f80 2023-08-09T14:16:15.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.821+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb610074600 con 0x7fb600003f80 2023-08-09T14:16:15.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.822+0000 7fb60d7fa700 1 -- 172.21.15.5:0/3124470514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fb604054400 con 0x7fb600003f80 2023-08-09T14:16:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:15.825 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:15.113531+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:15:24.652455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T14:15:25.741922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:15.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 msgr2=0x7fb5f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6101539d0 tx=0x7fb5fc00a000 comp rx=0 tx=0).stop 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 msgr2=0x7fb6101571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb604011aa0 tx=0x7fb604011e60 comp rx=0 tx=0).stop 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 shutdown_connections 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb610158730 0x7fb61015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb600003f80 0x7fb6101571d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 --2- 172.21.15.5:0/3124470514 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb610157710 0x7fb6101581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 >> 172.21.15.5:0/3124470514 conn(0x7fb6100b1900 msgr2=0x7fb61006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 shutdown_connections 2023-08-09T14:16:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.824+0000 7fb616c2a700 1 -- 172.21.15.5:0/3124470514 wait complete. 2023-08-09T14:16:15.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T14:16:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.962+0000 7f98d74be700 1 Processor -- start 2023-08-09T14:16:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.962+0000 7f98d74be700 1 -- start start 2023-08-09T14:16:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d74be700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98d0071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d74be700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f98d006a1c0 0x7f98d006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d74be700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00716b0 con 0x7f98d00cc730 2023-08-09T14:16:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d74be700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d006eb60 con 0x7f98d006a1c0 2023-08-09T14:16:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d74be700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d006ab80 con 0x7f98d015b020 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d5a5b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f98d00cc730 0x7f98d00ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57718/0 (socket says 172.21.15.5:57718) 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d5a5b700 1 -- 172.21.15.5:0/1542633837 learned_addr learned my addr 172.21.15.5:0/1542633837 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1542633837 >> v2:172.21.15.101:3300/0 conn(0x7f98d006a1c0 0x7f98d006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98d525a700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98d0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445193223 0 0) 0x7f98c8001490 con 0x7f98d00cc730 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98bc0035b0 con 0x7f98d00cc730 2023-08-09T14:16:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1086209978 0 0) 0x7f98bc0035b0 con 0x7f98d00cc730 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 msgr2=0x7f98d0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98d0071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 >> v2:172.21.15.101:3300/0 conn(0x7f98d006a1c0 msgr2=0x7f98d006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 --2- 172.21.15.5:0/1542633837 >> v2:172.21.15.101:3300/0 conn(0x7f98d006a1c0 0x7f98d006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.963+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d006e4c0 con 0x7f98d00cc730 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f98c8001b80 con 0x7f98d00cc730 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 >> v1:172.21.15.5:6789/0 conn(0x7f98d00cc730 legacy=0x7f98d00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98bc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98bc003f80 0x7f98bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc004d90 0x7f98bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d006eb60 con 0x7f98bc003f80 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d006ab80 con 0x7f98bc004d90 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc00ba10 con 0x7f98d015b020 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98bc003f80 0x7f98bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d525a700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98bc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d5a5b700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc004d90 0x7f98bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 -- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 msgr2=0x7f98bc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015b020 0x7f98bc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 -- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc004d90 msgr2=0x7f98bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc004d90 0x7f98bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 -- 172.21.15.5:0/1542633837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0035b0 con 0x7f98bc003f80 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98bc003f80 0x7f98bc004850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009b60 tx=0x7f98bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66df299feed09a04 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000e660 con 0x7f98bc003f80 2023-08-09T14:16:15.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000e7c0 con 0x7f98bc003f80 2023-08-09T14:16:15.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.964+0000 7f98c7fff700 1 -- 172.21.15.5:0/1542633837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000eb30 con 0x7f98bc003f80 2023-08-09T14:16:15.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 -- 172.21.15.5:0/1542633837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98bc003f80 msgr2=0x7f98bc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 --2- 172.21.15.5:0/1542633837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98bc003f80 0x7f98bc004850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009b60 tx=0x7f98bc005880 comp rx=0 tx=0).stop 2023-08-09T14:16:15.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d5a5b700 1 -- 172.21.15.5:0/1542633837 reap_dead start 2023-08-09T14:16:15.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 -- 172.21.15.5:0/1542633837 shutdown_connections 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 -- 172.21.15.5:0/1542633837 >> 172.21.15.5:0/1542633837 conn(0x7f98d00b1900 msgr2=0x7f98d00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 -- 172.21.15.5:0/1542633837 shutdown_connections 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.965+0000 7f98d74be700 1 -- 172.21.15.5:0/1542633837 wait complete. 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.966+0000 7f98d74be700 1 Processor -- start 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.966+0000 7f98d74be700 1 -- start start 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc003f80 0x7f98d014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015db10 0x7f98d00a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d015df90 con 0x7f98d014c5d0 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00a91b0 con 0x7f98bc003f80 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d74be700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d014baf0 con 0x7f98d015db10 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44312/0 (socket says 172.21.15.5:44312) 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 -- 172.21.15.5:0/1411581287 learned_addr learned my addr 172.21.15.5:0/1411581287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:15.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d525a700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc003f80 0x7f98d014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d5a5b700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015db10 0x7f98d00a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 -- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015db10 msgr2=0x7f98d00a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015db10 0x7f98d00a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 -- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc003f80 msgr2=0x7f98d014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc003f80 0x7f98d014b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.967+0000 7f98d4a59700 1 -- 172.21.15.5:0/1411581287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d014bdd0 con 0x7f98d014c5d0 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98d4a59700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98c0000c00 tx=0x7f98c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000e660 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0003ad0 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d014c0b0 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0003e80 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.968+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d00a89e0 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.969+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d014c420 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.969+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98c0013470 con 0x7f98d014c5d0 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.970+0000 7f98c5ffb700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 0x7f98b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.970+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f98c0089d40 con 0x7f98d014c5d0 2023-08-09T14:16:15.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.970+0000 7f98d525a700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 0x7f98b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:15.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.970+0000 7f98d525a700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 0x7f98b406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d015e4d0 tx=0x7f98cc009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:15.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:15.974+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f98c0058f10 con 0x7f98d014c5d0 2023-08-09T14:16:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.220+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f98d014c240 con 0x7f98d014c5d0 2023-08-09T14:16:16.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-08-09T14:16:16.220+0000 7f464dd27700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T14:16:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.224+0000 7f98c5ffb700 1 -- 172.21.15.5:0/1411581287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f98c0017090 con 0x7f98d014c5d0 2023-08-09T14:16:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 msgr2=0x7f98b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 0x7f98b406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d015e4d0 tx=0x7f98cc009210 comp rx=0 tx=0).stop 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 msgr2=0x7f98d015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98c0000c00 tx=0x7f98c00047c0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 shutdown_connections 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f98b406a0e0 0x7f98b406c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f98d015db10 0x7f98d00a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f98bc003f80 0x7f98d014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 --2- 172.21.15.5:0/1411581287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98d014c5d0 0x7f98d015d5d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 >> 172.21.15.5:0/1411581287 conn(0x7f98d00b1900 msgr2=0x7f98d00c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 shutdown_connections 2023-08-09T14:16:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.226+0000 7f98d74be700 1 -- 172.21.15.5:0/1411581287 wait complete. 2023-08-09T14:16:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T14:16:16.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T14:16:16.267 INFO:tasks.ceph.mds.b.smithi101.stdout:starting mds.b at 2023-08-09T14:16:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.365+0000 7f33f6f55700 1 Processor -- start 2023-08-09T14:16:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.365+0000 7f33f6f55700 1 -- start start 2023-08-09T14:16:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f6f55700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33f00b2c70 0x7f33f00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f6f55700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00cb2d0 con 0x7f33f0159e90 2023-08-09T14:16:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f6f55700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00cb5b0 con 0x7f33f00ce410 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f6f55700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00cb890 con 0x7f33f00b2c70 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f4cf1700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33f0159e90 0x7f33f006db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57734/0 (socket says 172.21.15.5:57734) 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33f4cf1700 1 -- 172.21.15.5:0/2040335780 learned_addr learned my addr 172.21.15.5:0/2040335780 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33effff700 1 --2- 172.21.15.5:0/2040335780 >> v2:172.21.15.5:3300/0 conn(0x7f33f00b2c70 0x7f33f00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33effff700 1 -- 172.21.15.5:0/2040335780 >> v1:172.21.15.101:6789/0 conn(0x7f33f00ce410 legacy=0x7f33f00cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33effff700 1 -- 172.21.15.5:0/2040335780 >> v1:172.21.15.5:6789/0 conn(0x7f33f0159e90 legacy=0x7f33f006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.366+0000 7f33effff700 1 -- 172.21.15.5:0/2040335780 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00cbb70 con 0x7f33f00b2c70 2023-08-09T14:16:16.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33effff700 1 --2- 172.21.15.5:0/2040335780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00b2c70 0x7f33f00cacd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009840 tx=0x7f33dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77eeee3fef28351 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:16.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33ef7fe700 1 -- 172.21.15.5:0/2040335780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc004230 con 0x7f33f00b2c70 2023-08-09T14:16:16.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33ef7fe700 1 -- 172.21.15.5:0/2040335780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc004390 con 0x7f33f00b2c70 2023-08-09T14:16:16.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33ef7fe700 1 -- 172.21.15.5:0/2040335780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0036a0 con 0x7f33f00b2c70 2023-08-09T14:16:16.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 -- 172.21.15.5:0/2040335780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00b2c70 msgr2=0x7f33f00cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 --2- 172.21.15.5:0/2040335780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00b2c70 0x7f33f00cacd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009840 tx=0x7f33dc009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:16.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 -- 172.21.15.5:0/2040335780 shutdown_connections 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 --2- 172.21.15.5:0/2040335780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00b2c70 0x7f33f00cacd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 -- 172.21.15.5:0/2040335780 >> 172.21.15.5:0/2040335780 conn(0x7f33f00b1970 msgr2=0x7f33f00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 -- 172.21.15.5:0/2040335780 shutdown_connections 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.367+0000 7f33f6f55700 1 -- 172.21.15.5:0/2040335780 wait complete. 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 Processor -- start 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 -- start start 2023-08-09T14:16:16.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f33f00b2c70 0x7f33f01f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f33f0159e90 0x7f33f00aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015b9b0 con 0x7f33f00ce410 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015bbc0 con 0x7f33f00b2c70 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.369+0000 7f33f6f55700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015bea0 con 0x7f33f0159e90 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44326/0 (socket says 172.21.15.5:44326) 2023-08-09T14:16:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 -- 172.21.15.5:0/1883131010 learned_addr learned my addr 172.21.15.5:0/1883131010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33f4cf1700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f33f00b2c70 0x7f33f01f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33f54f2700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f33f0159e90 0x7f33f00aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 -- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f33f0159e90 msgr2=0x7f33f00aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f33f0159e90 0x7f33f00aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 -- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f33f00b2c70 msgr2=0x7f33f01f0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f33f00b2c70 0x7f33f01f0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 -- 172.21.15.5:0/1883131010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0094a0 con 0x7f33f00ce410 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33effff700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0090b0 tx=0x7f33dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc003ea0 con 0x7f33f00ce410 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc01e070 con 0x7f33f00ce410 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc011850 con 0x7f33f00ce410 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f015c180 con 0x7f33f00ce410 2023-08-09T14:16:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.370+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f015c740 con 0x7f33f00ce410 2023-08-09T14:16:16.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.371+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f015c930 con 0x7f33f00ce410 2023-08-09T14:16:16.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.372+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33dc0119b0 con 0x7f33f00ce410 2023-08-09T14:16:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.372+0000 7f33ed7fa700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 0x7f33d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.372+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f33dc0897c0 con 0x7f33f00ce410 2023-08-09T14:16:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.373+0000 7f33f4cf1700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 0x7f33d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.373+0000 7f33f4cf1700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 0x7f33d406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.377+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f33dc054eb0 con 0x7f33f00ce410 2023-08-09T14:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:16.625+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33f0074600 con 0x7f33f00ce410 2023-08-09T14:16:17.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.224+0000 7f33ed7fa700 1 -- 172.21.15.5:0/1883131010 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33dc0584d0 con 0x7f33f00ce410 2023-08-09T14:16:17.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 msgr2=0x7f33d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 0x7f33d406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4007f10 comp rx=0 tx=0).stop 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 msgr2=0x7f33f015afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0090b0 tx=0x7f33dc004750 comp rx=0 tx=0).stop 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 shutdown_connections 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f33d406a0e0 0x7f33d406c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f33f0159e90 0x7f33f00aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f33f00b2c70 0x7f33f01f0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 --2- 172.21.15.5:0/1883131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f00ce410 0x7f33f015afa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 >> 172.21.15.5:0/1883131010 conn(0x7f33f00b1970 msgr2=0x7f33f00afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 shutdown_connections 2023-08-09T14:16:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.227+0000 7f33f6f55700 1 -- 172.21.15.5:0/1883131010 wait complete. 2023-08-09T14:16:17.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T14:16:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.379+0000 7f4b24ef3700 1 Processor -- start 2023-08-09T14:16:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.379+0000 7f4b24ef3700 1 -- start start 2023-08-09T14:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 0x7f4b2006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2015d470 0x7f4b2006b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b200b35a0 0x7f4b2006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2006d340 con 0x7f4b2015d470 2023-08-09T14:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200ceb70 con 0x7f4b2015d090 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b24ef3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200cf130 con 0x7f4b200b35a0 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2015d470 0x7f4b2006b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2015d470 0x7f4b2006b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44334/0 (socket says 172.21.15.5:44334) 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/61881626 learned_addr learned my addr 172.21.15.5:0/61881626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1e59c700 1 --2- 172.21.15.5:0/61881626 >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 0x7f4b2006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1ed9d700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b200b35a0 0x7f4b2006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/61881626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b200b35a0 msgr2=0x7f4b2006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b200b35a0 0x7f4b2006b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/61881626 >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 msgr2=0x7f4b2006ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/61881626 >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 0x7f4b2006ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/61881626 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200d1470 con 0x7f4b2015d470 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.380+0000 7f4b1e59c700 1 --2- 172.21.15.5:0/61881626 >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 0x7f4b2006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d470 0x7f4b2006b2d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b200ceac0 tx=0x7f4b14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6bd9885d7e7b35 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b1d59a700 1 -- 172.21.15.5:0/61881626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400b870 con 0x7f4b2015d470 2023-08-09T14:16:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b1d59a700 1 -- 172.21.15.5:0/61881626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400b9d0 con 0x7f4b2015d470 2023-08-09T14:16:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b1d59a700 1 -- 172.21.15.5:0/61881626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400bd60 con 0x7f4b2015d470 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 -- 172.21.15.5:0/61881626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d470 msgr2=0x7f4b2006b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d470 0x7f4b2006b2d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b200ceac0 tx=0x7f4b14009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 -- 172.21.15.5:0/61881626 shutdown_connections 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/61881626 >> v2:172.21.15.101:3300/0 conn(0x7f4b2015d090 0x7f4b2006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b200b35a0 0x7f4b2006b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/61881626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d470 0x7f4b2006b2d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 -- 172.21.15.5:0/61881626 >> 172.21.15.5:0/61881626 conn(0x7f4b20065f50 msgr2=0x7f4b20066330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 -- 172.21.15.5:0/61881626 shutdown_connections 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.381+0000 7f4b24ef3700 1 -- 172.21.15.5:0/61881626 wait complete. 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 Processor -- start 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 -- start start 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4b200b35a0 0x7f4b2014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b2015d470 0x7f4b200b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200af210 con 0x7f4b2015d090 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200af4f0 con 0x7f4b200b35a0 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.383+0000 7f4b24ef3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200af7d0 con 0x7f4b2015d470 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44340/0 (socket says 172.21.15.5:44340) 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/324773941 learned_addr learned my addr 172.21.15.5:0/324773941 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1e59c700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4b200b35a0 0x7f4b2014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1ed9d700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b2015d470 0x7f4b200b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b2015d470 msgr2=0x7f4b200b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b2015d470 0x7f4b200b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4b200b35a0 msgr2=0x7f4b2014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4b200b35a0 0x7f4b2014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 -- 172.21.15.5:0/324773941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009550 con 0x7f4b2015d090 2023-08-09T14:16:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b1dd9b700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000c00 tx=0x7f4b14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004310 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1401e070 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140036a0 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200afab0 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.384+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200aef00 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.385+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b200affd0 con 0x7f4b2015d090 2023-08-09T14:16:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.386+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b14020030 con 0x7f4b2015d090 2023-08-09T14:16:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.386+0000 7f4b0effd700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 0x7f4b0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.386+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f4b14089480 con 0x7f4b2015d090 2023-08-09T14:16:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.386+0000 7f4b1e59c700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 0x7f4b0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.387+0000 7f4b1e59c700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 0x7f4b0006c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b201f5e80 tx=0x7f4b10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.391+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4b200affd0 con 0x7f4b2015d090 2023-08-09T14:16:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:17.592+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b200affd0 con 0x7f4b2015d090 2023-08-09T14:16:18.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.231+0000 7f4b0effd700 1 -- 172.21.15.5:0/324773941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b200affd0 con 0x7f4b2015d090 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 msgr2=0x7f4b0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 0x7f4b0006c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b201f5e80 tx=0x7f4b10008040 comp rx=0 tx=0).stop 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 msgr2=0x7f4b200ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000c00 tx=0x7f4b14004750 comp rx=0 tx=0).stop 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 shutdown_connections 2023-08-09T14:16:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4b0006a0e0 0x7f4b0006c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4b2015d470 0x7f4b200b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4b200b35a0 0x7f4b2014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 --2- 172.21.15.5:0/324773941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2015d090 0x7f4b200ae9c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.235+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 >> 172.21.15.5:0/324773941 conn(0x7f4b20065f50 msgr2=0x7f4b2006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.236+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 shutdown_connections 2023-08-09T14:16:18.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.236+0000 7f4b24ef3700 1 -- 172.21.15.5:0/324773941 wait complete. 2023-08-09T14:16:18.240 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-08-09T14:16:18.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T14:16:18.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.387+0000 7f6f3b060700 1 Processor -- start 2023-08-09T14:16:18.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.387+0000 7f6f3b060700 1 -- start start 2023-08-09T14:16:18.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f3b060700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f3415d4b0 0x7f6f340d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f3b060700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f6f340d0e80 0x7f6f340d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f3b060700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f340d13d0 con 0x7f6f340b8d60 2023-08-09T14:16:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f3b060700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340b5f90 con 0x7f6f3415d4b0 2023-08-09T14:16:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f3b060700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340b6270 con 0x7f6f340d0e80 2023-08-09T14:16:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f38dfc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f3415d4b0 0x7f6f340d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f33fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f340b8d60 0x7f6f340cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57762/0 (socket says 172.21.15.5:57762) 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f33fff700 1 -- 172.21.15.5:0/3769962682 learned_addr learned my addr 172.21.15.5:0/3769962682 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f395fd700 1 --2- 172.21.15.5:0/3769962682 >> v2:172.21.15.101:3300/0 conn(0x7f6f340d0e80 0x7f6f340d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f38dfc700 1 -- 172.21.15.5:0/3769962682 >> v2:172.21.15.101:3300/0 conn(0x7f6f340d0e80 msgr2=0x7f6f340d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f38dfc700 1 --2- 172.21.15.5:0/3769962682 >> v2:172.21.15.101:3300/0 conn(0x7f6f340d0e80 0x7f6f340d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f38dfc700 1 -- 172.21.15.5:0/3769962682 >> v1:172.21.15.5:6789/0 conn(0x7f6f340b8d60 legacy=0x7f6f340cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f337fe700 1 -- 172.21.15.5:0/3769962682 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313031701 0 0) 0x7f6f340d13d0 con 0x7f6f340b8d60 2023-08-09T14:16:18.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.388+0000 7f6f38dfc700 1 -- 172.21.15.5:0/3769962682 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340b6550 con 0x7f6f3415d4b0 2023-08-09T14:16:18.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f38dfc700 1 --2- 172.21.15.5:0/3769962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f3415d4b0 0x7f6f340d1660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f340d3040 tx=0x7f6f28009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fe59f537911954 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:18.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f337fe700 1 -- 172.21.15.5:0/3769962682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28011830 con 0x7f6f3415d4b0 2023-08-09T14:16:18.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f337fe700 1 -- 172.21.15.5:0/3769962682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28011990 con 0x7f6f3415d4b0 2023-08-09T14:16:18.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f337fe700 1 -- 172.21.15.5:0/3769962682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28011d20 con 0x7f6f3415d4b0 2023-08-09T14:16:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 -- 172.21.15.5:0/3769962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f3415d4b0 msgr2=0x7f6f340d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 --2- 172.21.15.5:0/3769962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f3415d4b0 0x7f6f340d1660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f340d3040 tx=0x7f6f28009b20 comp rx=0 tx=0).stop 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 -- 172.21.15.5:0/3769962682 shutdown_connections 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 --2- 172.21.15.5:0/3769962682 >> v2:172.21.15.101:3300/0 conn(0x7f6f340d0e80 0x7f6f340d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 --2- 172.21.15.5:0/3769962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f3415d4b0 0x7f6f340d1660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 -- 172.21.15.5:0/3769962682 >> 172.21.15.5:0/3769962682 conn(0x7f6f340d30a0 msgr2=0x7f6f340d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 -- 172.21.15.5:0/3769962682 shutdown_connections 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.389+0000 7f6f3b060700 1 -- 172.21.15.5:0/3769962682 wait complete. 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.391+0000 7f6f3b060700 1 Processor -- start 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.391+0000 7f6f3b060700 1 -- start start 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f340b8d60 0x7f6f341f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f3415d4b0 0x7f6f340c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f341f6660 con 0x7f6f340d0e80 2023-08-09T14:16:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415d890 con 0x7f6f3415d4b0 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415db30 con 0x7f6f340b8d60 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44354/0 (socket says 172.21.15.5:44354) 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 -- 172.21.15.5:0/992630637 learned_addr learned my addr 172.21.15.5:0/992630637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f395fd700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f3415d4b0 0x7f6f340c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 -- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f340b8d60 msgr2=0x7f6f341f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f340b8d60 0x7f6f341f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 -- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f3415d4b0 msgr2=0x7f6f340c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f3415d4b0 0x7f6f340c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 -- 172.21.15.5:0/992630637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280094a0 con 0x7f6f340d0e80 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f33fff700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f200011e0 tx=0x7f6f2000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20004c80 con 0x7f6f340d0e80 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20004e00 con 0x7f6f340d0e80 2023-08-09T14:16:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3415de10 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007310 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.392+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3415e3d0 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.393+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34074600 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.394+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f20007470 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.394+0000 7f6f317fa700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 0x7f6f1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.394+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f6f200881b0 con 0x7f6f340d0e80 2023-08-09T14:16:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.394+0000 7f6f38dfc700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 0x7f6f1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.395+0000 7f6f38dfc700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 0x7f6f1806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f280090b0 tx=0x7f6f28010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.399+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f20053a50 con 0x7f6f340d0e80 2023-08-09T14:16:18.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:18.601+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f34073b80 con 0x7f6f340d0e80 2023-08-09T14:16:19.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.232+0000 7f6f317fa700 1 -- 172.21.15.5:0/992630637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6f20057070 con 0x7f6f340d0e80 2023-08-09T14:16:19.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 msgr2=0x7f6f1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 0x7f6f1806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f280090b0 tx=0x7f6f28010000 comp rx=0 tx=0).stop 2023-08-09T14:16:19.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 msgr2=0x7f6f3415a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f200011e0 tx=0x7f6f2000cae0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 shutdown_connections 2023-08-09T14:16:19.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f6f1806a0e0 0x7f6f1806c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f6f3415d4b0 0x7f6f340c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f6f340b8d60 0x7f6f341f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 --2- 172.21.15.5:0/992630637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f340d0e80 0x7f6f3415a690 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 >> 172.21.15.5:0/992630637 conn(0x7f6f340d30a0 msgr2=0x7f6f3406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 shutdown_connections 2023-08-09T14:16:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.235+0000 7f6f3b060700 1 -- 172.21.15.5:0/992630637 wait complete. 2023-08-09T14:16:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-08-09T14:16:19.253 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T14:16:19.253 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T14:16:19.253 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T14:16:19.253 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T14:16:19.254 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T14:16:19.254 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T14:16:19.254 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T14:16:19.254 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T14:16:19.255 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T14:16:19.255 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T14:16:19.255 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T14:16:19.255 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T14:16:19.255 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T14:16:19.256 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T14:16:19.256 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T14:16:19.256 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T14:16:19.266 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T14:16:19.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T14:16:19.267 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T14:16:19.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T14:16:19.270 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T14:16:19.270 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T14:16:19.272 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T14:16:19.272 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T14:16:19.308 INFO:tasks.ceph.mds.a:Started 2023-08-09T14:16:19.309 DEBUG:teuthology.parallel:result is None 2023-08-09T14:16:19.309 INFO:tasks.ceph.mds.c:Started 2023-08-09T14:16:19.310 DEBUG:teuthology.parallel:result is None 2023-08-09T14:16:19.312 INFO:tasks.ceph.mds.b:Started 2023-08-09T14:16:19.312 DEBUG:teuthology.parallel:result is None 2023-08-09T14:16:19.313 INFO:tasks.ceph.mds.d:Started 2023-08-09T14:16:19.313 DEBUG:teuthology.parallel:result is None 2023-08-09T14:16:19.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T14:16:19.400 INFO:tasks.ceph.mds.b.smithi101.stdout:starting mds.b at 2023-08-09T14:16:19.400 INFO:tasks.ceph.mds.d.smithi101.stdout:starting mds.d at 2023-08-09T14:16:19.421 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-08-09T14:16:19.430 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-08-09T14:16:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.482+0000 7fade673c700 1 Processor -- start 2023-08-09T14:16:19.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.482+0000 7fade673c700 1 -- start start 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade673c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade673c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade00cee00 con 0x7fade015b360 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade673c700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade015eb20 con 0x7fade0154600 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade673c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade015e2d0 con 0x7fade00ce410 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddf7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fade015b360 0x7fade015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57800/0 (socket says 172.21.15.5:57800) 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddf7fe700 1 -- 172.21.15.5:0/900469501 learned_addr learned my addr 172.21.15.5:0/900469501 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade4cd9700 1 --2- 172.21.15.5:0/900469501 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248623513 0 0) 0x7fadd4001110 con 0x7fade015b360 2023-08-09T14:16:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc80035b0 con 0x7fade015b360 2023-08-09T14:16:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810656790 0 0) 0x7fade015eb20 con 0x7fade0154600 2023-08-09T14:16:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4001110 con 0x7fade0154600 2023-08-09T14:16:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade4cd9700 1 -- 172.21.15.5:0/900469501 >> v1:172.21.15.101:6789/0 conn(0x7fade0154600 legacy=0x7fade015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade4cd9700 1 -- 172.21.15.5:0/900469501 >> v1:172.21.15.5:6789/0 conn(0x7fade015b360 legacy=0x7fade015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade4cd9700 1 -- 172.21.15.5:0/900469501 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade006d4f0 con 0x7fade00ce410 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7fade4cd9700 1 --2- 172.21.15.5:0/900469501 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade00ce8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009dc0 tx=0x7fadd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f29b25a3852f3d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.483+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800e070 con 0x7fade00ce410 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800bb20 con 0x7fade00ce410 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7faddeffd700 1 -- 172.21.15.5:0/900469501 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8012430 con 0x7fade00ce410 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 -- 172.21.15.5:0/900469501 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 msgr2=0x7fade00ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 --2- 172.21.15.5:0/900469501 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade00ce8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009dc0 tx=0x7fadd800b330 comp rx=0 tx=0).stop 2023-08-09T14:16:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 -- 172.21.15.5:0/900469501 shutdown_connections 2023-08-09T14:16:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 --2- 172.21.15.5:0/900469501 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade00ce8c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 -- 172.21.15.5:0/900469501 >> 172.21.15.5:0/900469501 conn(0x7fade00b1900 msgr2=0x7fade00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 -- 172.21.15.5:0/900469501 shutdown_connections 2023-08-09T14:16:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.484+0000 7fade673c700 1 -- 172.21.15.5:0/900469501 wait complete. 2023-08-09T14:16:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.485+0000 7fade673c700 1 Processor -- start 2023-08-09T14:16:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 -- start start 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fade015b360 0x7fade0152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade00cbbc0 con 0x7fade0154600 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade00cac60 con 0x7fade015b360 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade673c700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00caf40 con 0x7fade00ce410 2023-08-09T14:16:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7faddf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7faddf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44390/0 (socket says 172.21.15.5:44390) 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7faddf7fe700 1 -- 172.21.15.5:0/1876584112 learned_addr learned my addr 172.21.15.5:0/1876584112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7fade4cd9700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fade015b360 0x7fade0152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.486+0000 7faddffff700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 -- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 msgr2=0x7fade014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 -- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fade015b360 msgr2=0x7fade0152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:19.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fade015b360 0x7fade0152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:19.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 -- 172.21.15.5:0/1876584112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009a70 con 0x7fade0154600 2023-08-09T14:16:19.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddf7fe700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005910 tx=0x7fadd400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:19.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4005d70 con 0x7fade0154600 2023-08-09T14:16:19.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd40070d0 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade00cb220 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4007460 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.487+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade00cb7e0 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.488+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0074600 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.488+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fadd40075c0 con 0x7fade0154600 2023-08-09T14:16:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.489+0000 7faddcff9700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 0x7fadcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.489+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fadd4087670 con 0x7fade0154600 2023-08-09T14:16:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.489+0000 7faddffff700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 0x7fadcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.490+0000 7faddffff700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 0x7fadcc06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fadd0001220 tx=0x7fadd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.493+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fadd4052fd0 con 0x7fade0154600 2023-08-09T14:16:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:19.709+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fade00cee00 con 0x7fade0154600 2023-08-09T14:16:20.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.246+0000 7faddcff9700 1 -- 172.21.15.5:0/1876584112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fade00cee00 con 0x7fade0154600 2023-08-09T14:16:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.248+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 msgr2=0x7fadcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.248+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 0x7fadcc06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fadd0001220 tx=0x7fadd0009040 comp rx=0 tx=0).stop 2023-08-09T14:16:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.248+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 msgr2=0x7fade014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.248+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005910 tx=0x7fadd400c9e0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 shutdown_connections 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fadcc06a0e0 0x7fadcc06c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fade015b360 0x7fade0152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fade00ce410 0x7fade014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 --2- 172.21.15.5:0/1876584112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade0154600 0x7fade014c360 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 >> 172.21.15.5:0/1876584112 conn(0x7fade00b1900 msgr2=0x7fade015bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 shutdown_connections 2023-08-09T14:16:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.249+0000 7fade673c700 1 -- 172.21.15.5:0/1876584112 wait complete. 2023-08-09T14:16:20.253 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-08-09T14:16:20.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T14:16:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.396+0000 7f3bf9d42700 1 Processor -- start 2023-08-09T14:16:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.397+0000 7f3bf9d42700 1 -- start start 2023-08-09T14:16:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf9d42700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 0x7f3bf415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf9d42700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf415eb20 con 0x7f3bf4154600 2023-08-09T14:16:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf9d42700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf406d4f0 con 0x7f3bf40ce410 2023-08-09T14:16:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf9d42700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf415e560 con 0x7f3bf415b360 2023-08-09T14:16:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bf4154600 0x7f3bf415b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57812/0 (socket says 172.21.15.5:57812) 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf37fe700 1 -- 172.21.15.5:0/4267489812 learned_addr learned my addr 172.21.15.5:0/4267489812 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf2ffd700 1 --2- 172.21.15.5:0/4267489812 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 0x7f3bf415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293176798 0 0) 0x7f3bf415eb20 con 0x7f3bf4154600 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be00035b0 con 0x7f3bf4154600 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748988144 0 0) 0x7f3bf406d4f0 con 0x7f3bf40ce410 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf415eb20 con 0x7f3bf40ce410 2023-08-09T14:16:20.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf2ffd700 1 -- 172.21.15.5:0/4267489812 >> v1:172.21.15.101:6789/0 conn(0x7f3bf40ce410 legacy=0x7f3bf40ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf2ffd700 1 -- 172.21.15.5:0/4267489812 >> v1:172.21.15.5:6789/0 conn(0x7f3bf4154600 legacy=0x7f3bf415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.398+0000 7f3bf2ffd700 1 -- 172.21.15.5:0/4267489812 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf415e840 con 0x7f3bf415b360 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf2ffd700 1 --2- 172.21.15.5:0/4267489812 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 0x7f3bf415dbc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009870 tx=0x7f3bdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb0b4884b797ddf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3bf415b360 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3bf415b360 2023-08-09T14:16:20.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf27fc700 1 -- 172.21.15.5:0/4267489812 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d00 con 0x7f3bf415b360 2023-08-09T14:16:20.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 -- 172.21.15.5:0/4267489812 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 msgr2=0x7f3bf415dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/4267489812 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 0x7f3bf415dbc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009870 tx=0x7f3bdc009b80 comp rx=0 tx=0).stop 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 -- 172.21.15.5:0/4267489812 shutdown_connections 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/4267489812 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf415b360 0x7f3bf415dbc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 -- 172.21.15.5:0/4267489812 >> 172.21.15.5:0/4267489812 conn(0x7f3bf40b1900 msgr2=0x7f3bf40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.399+0000 7f3bf9d42700 1 -- 172.21.15.5:0/4267489812 shutdown_connections 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.400+0000 7f3bf9d42700 1 -- 172.21.15.5:0/4267489812 wait complete. 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.401+0000 7f3bf9d42700 1 Processor -- start 2023-08-09T14:16:20.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.401+0000 7f3bf9d42700 1 -- start start 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3bf40ce410 0x7f3bf41581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf4154600 0x7f3bf414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c76c0 con 0x7f3bf415b360 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41561c0 con 0x7f3bf40ce410 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf9d42700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4158710 con 0x7f3bf4154600 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44406/0 (socket says 172.21.15.5:44406) 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.402+0000 7f3bf3fff700 1 -- 172.21.15.5:0/581101819 learned_addr learned my addr 172.21.15.5:0/581101819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf2ffd700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf4154600 0x7f3bf414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf37fe700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3bf40ce410 0x7f3bf41581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 -- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf4154600 msgr2=0x7f3bf414fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf4154600 0x7f3bf414fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 -- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3bf40ce410 msgr2=0x7f3bf41581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3bf40ce410 0x7f3bf41581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 -- 172.21.15.5:0/581101819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0094a0 con 0x7f3bf415b360 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf3fff700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bec002220 tx=0x7f3bec00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec003a00 con 0x7f3bf415b360 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec003b60 con 0x7f3bf415b360 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf4153480 con 0x7f3bf415b360 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0050d0 con 0x7f3bf415b360 2023-08-09T14:16:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.403+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40c7bf0 con 0x7f3bf415b360 2023-08-09T14:16:20.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.404+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf40c3310 con 0x7f3bf415b360 2023-08-09T14:16:20.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.404+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3bec005230 con 0x7f3bf415b360 2023-08-09T14:16:20.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.405+0000 7f3bebfff700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 0x7f3bd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.405+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3bec08a9d0 con 0x7f3bf415b360 2023-08-09T14:16:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.405+0000 7f3bf37fe700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 0x7f3bd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.406+0000 7f3bf37fe700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 0x7f3bd406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3be4007fd0 tx=0x7f3be4007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.410+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3bec056390 con 0x7f3bf415b360 2023-08-09T14:16:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.692+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3bf415e0d0 con 0x7f3bf415b360 2023-08-09T14:16:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.693+0000 7f3bebfff700 1 -- 172.21.15.5:0/581101819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3bec01f090 con 0x7f3bf415b360 2023-08-09T14:16:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:20.695 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9Nkxx6IDhAAh6fGbGQT8Zs489D8ML/jzg==", 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-08-09T14:16:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NkrJ8ZGxAA49LvzxDz/hwDeW57a0gylg==", 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9Nk4S76FRAAvqqBa6qx9ss7DSzihjClyQ==", 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NkFC9eIhAA57JSI1rttlgomykIrgnDoA==", 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOn9NkcCfCCxAArUTRcF9mweu6a1l+ffuAFg==", 2023-08-09T14:16:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-08-09T14:16:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBRn9NkGlFpCxAASZ/WpUIoncYZjR0cZzpz6A==", 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBUn9Nkc0O8ChAA85nALOg7BBJJx/ZElfnYiQ==", 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBXn9Nk0t/2CxAA9HVJQ4xQT3OB2IWLFp8V+A==", 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBdn9Nkjw66DBAALjbqCtEC8v5BxcQG8G9frA==", 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBgn9NkwGGHCxAAAskMVCNTzr8IVSSIWyqieA==", 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBjn9NkZYh/ChAAuQyDmigIoxW2VMVwdeYklg==", 2023-08-09T14:16:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-08-09T14:16:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBmn9NknFWgCRAAq60J5i7dZMpPeDGKChy1gA==", 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NkwcnEJhAANZnn6ZDBepG6wauF6Holcg==", 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NkM0HQLRAAoRH1uJWb+uuKsD9tVQOKLw==", 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-08-09T14:16:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NklFAvKhAABoiDkwu6jJjQhfj66Rr9/A==", 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-08-09T14:16:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9Nko553MxAAcHI10HryL5LlAB1u/RuNcQ==", 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ==", 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9Nks+QqCBAAXiPY77sDFMlX5t8lltFXwg==", 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2023-08-09T14:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9NkRu8qCBAABqC88Kge/a0DE/4OO4HU+A==", 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9NktvcqCBAA0FUA9aToV4w+U+Xx5L16hA==", 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9NkmP8qCBAA5JlFenIA2TutOOfQCldKoA==", 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9NkzAcrCBAANV6WbBuUHSOEAODS69Lqbg==", 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBsn9NkIRArCBAAKBO3CLvfTh9AwLnxYnakag==", 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-08-09T14:16:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NknqoJCxAA2Zyaj93AlUX1zCUg36XHBQ==", 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBMn9NkW0jaBRAAVAXnGaN6bxlcMYZcRtUk5w==", 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-08-09T14:16:20.725 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-08-09T14:16:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 msgr2=0x7f3bd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 0x7f3bd406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3be4007fd0 tx=0x7f3be4007dc0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 msgr2=0x7f3bf40c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bec002220 tx=0x7f3bec00c550 comp rx=0 tx=0).stop 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 shutdown_connections 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f3bd406a0e0 0x7f3bd406c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf415b360 0x7f3bf40c9220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f3bf40ce410 0x7f3bf41581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 --2- 172.21.15.5:0/581101819 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f3bf4154600 0x7f3bf414fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 >> 172.21.15.5:0/581101819 conn(0x7f3bf40b1900 msgr2=0x7f3bf406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 shutdown_connections 2023-08-09T14:16:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.695+0000 7f3bf9d42700 1 -- 172.21.15.5:0/581101819 wait complete. 2023-08-09T14:16:20.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-09T14:16:20.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.851+0000 7f21371bb700 1 Processor -- start 2023-08-09T14:16:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.851+0000 7f21371bb700 1 -- start start 2023-08-09T14:16:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f21371bb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2130154600 0x7f213015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f21371bb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f213015b360 0x7f213015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f21371bb700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213015eb20 con 0x7f21300ce410 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f21371bb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213006d4f0 con 0x7f213015b360 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f21371bb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213015e560 con 0x7f2130154600 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f212ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f213015b360 0x7f213015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f212ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f213015b360 0x7f213015dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44412/0 (socket says 172.21.15.5:44412) 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f212ffff700 1 -- 172.21.15.5:0/323537026 learned_addr learned my addr 172.21.15.5:0/323537026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.852+0000 7f2134f57700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2130154600 0x7f213015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212ffff700 1 -- 172.21.15.5:0/323537026 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2130154600 msgr2=0x7f213015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212ffff700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2130154600 0x7f213015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212ffff700 1 -- 172.21.15.5:0/323537026 >> v1:172.21.15.101:6789/0 conn(0x7f21300ce410 legacy=0x7f213006dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212ffff700 1 -- 172.21.15.5:0/323537026 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213015e840 con 0x7f213015b360 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212ffff700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f213015b360 0x7f213015dbc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f211c00bb90 tx=0x7f211c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7e319099dafa9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212f7fe700 1 -- 172.21.15.5:0/323537026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00dd50 con 0x7f213015b360 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212f7fe700 1 -- 172.21.15.5:0/323537026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c010470 con 0x7f213015b360 2023-08-09T14:16:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f212f7fe700 1 -- 172.21.15.5:0/323537026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c010800 con 0x7f213015b360 2023-08-09T14:16:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f21371bb700 1 -- 172.21.15.5:0/323537026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f213015b360 msgr2=0x7f213015dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.853+0000 7f21371bb700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f213015b360 0x7f213015dbc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f211c00bb90 tx=0x7f211c00bea0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 -- 172.21.15.5:0/323537026 shutdown_connections 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f2130154600 0x7f213015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 --2- 172.21.15.5:0/323537026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f213015b360 0x7f213015dbc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 -- 172.21.15.5:0/323537026 >> 172.21.15.5:0/323537026 conn(0x7f21300b1900 msgr2=0x7f21300b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 -- 172.21.15.5:0/323537026 shutdown_connections 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.854+0000 7f21371bb700 1 -- 172.21.15.5:0/323537026 wait complete. 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.855+0000 7f21371bb700 1 Processor -- start 2023-08-09T14:16:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.855+0000 7f21371bb700 1 -- start start 2023-08-09T14:16:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2130154600 0x7f213014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f213015b360 0x7f21300cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300c9d90 con 0x7f21300ce410 2023-08-09T14:16:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300b5850 con 0x7f2130154600 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21301ef2a0 con 0x7f213015b360 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44416/0 (socket says 172.21.15.5:44416) 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 -- 172.21.15.5:0/561657602 learned_addr learned my addr 172.21.15.5:0/561657602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 -- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f213015b360 msgr2=0x7f21300cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f213015b360 0x7f21300cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 -- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2130154600 msgr2=0x7f213014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2130154600 0x7f213014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 -- 172.21.15.5:0/561657602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c00b7f0 con 0x7f21300ce410 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f2134f57700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f212400e810 tx=0x7f212400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124013610 con 0x7f21300ce410 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124013770 con 0x7f21300ce410 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21301ef580 con 0x7f21300ce410 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.856+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124013b20 con 0x7f21300ce410 2023-08-09T14:16:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.857+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21300c9050 con 0x7f21300ce410 2023-08-09T14:16:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.857+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300c8bd0 con 0x7f21300ce410 2023-08-09T14:16:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.858+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2124013c80 con 0x7f21300ce410 2023-08-09T14:16:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.859+0000 7f212d7fa700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 0x7f211406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.859+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f21240881c0 con 0x7f21300ce410 2023-08-09T14:16:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.859+0000 7f212ffff700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 0x7f211406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.859+0000 7f212ffff700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 0x7f211406c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f213015b740 tx=0x7f211c012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:20.863+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2124053bf0 con 0x7f21300ce410 2023-08-09T14:16:21.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.145+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f21300c8bd0 con 0x7f21300ce410 2023-08-09T14:16:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.149+0000 7f212d7fa700 1 -- 172.21.15.5:0/561657602 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f21300c8bd0 con 0x7f21300ce410 2023-08-09T14:16:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 msgr2=0x7f211406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 0x7f211406c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f213015b740 tx=0x7f211c012000 comp rx=0 tx=0).stop 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 msgr2=0x7f21300c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f212400e810 tx=0x7f212400ebd0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 shutdown_connections 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f211406a0e0 0x7f211406c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f213015b360 0x7f21300cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300ce410 0x7f21300c9850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 --2- 172.21.15.5:0/561657602 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f2130154600 0x7f213014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 >> 172.21.15.5:0/561657602 conn(0x7f21300b1900 msgr2=0x7f213015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:21.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 shutdown_connections 2023-08-09T14:16:21.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.151+0000 7f21371bb700 1 -- 172.21.15.5:0/561657602 wait complete. 2023-08-09T14:16:21.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-09T14:16:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.291+0000 7f2804561700 1 Processor -- start 2023-08-09T14:16:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.291+0000 7f2804561700 1 -- start start 2023-08-09T14:16:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2804561700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f27fc15d400 0x7f27fc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2804561700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27fc06a1c0 0x7f27fc06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2804561700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc06e850 con 0x7f27fc06cd50 2023-08-09T14:16:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2804561700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc06ab80 con 0x7f27fc06a1c0 2023-08-09T14:16:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2804561700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0cf7b0 con 0x7f27fc15d400 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27fc06a1c0 0x7f27fc06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27fc06a1c0 0x7f27fc06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44428/0 (socket says 172.21.15.5:44428) 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 -- 172.21.15.5:0/1628424067 learned_addr learned my addr 172.21.15.5:0/1628424067 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f28022fd700 1 --2- 172.21.15.5:0/1628424067 >> v2:172.21.15.101:3300/0 conn(0x7f27fc15d400 0x7f27fc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 -- 172.21.15.5:0/1628424067 >> v2:172.21.15.101:3300/0 conn(0x7f27fc15d400 msgr2=0x7f27fc0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 --2- 172.21.15.5:0/1628424067 >> v2:172.21.15.101:3300/0 conn(0x7f27fc15d400 0x7f27fc0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 -- 172.21.15.5:0/1628424067 >> v1:172.21.15.101:6789/0 conn(0x7f27fc06cd50 legacy=0x7f27fc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 -- 172.21.15.5:0/1628424067 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc0cfa90 con 0x7f27fc06a1c0 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.292+0000 7f2801afc700 1 --2- 172.21.15.5:0/1628424067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc06a640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f27fc071260 tx=0x7f27ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1911aa094949739 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f28012fb700 1 -- 172.21.15.5:0/1628424067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec004230 con 0x7f27fc06a1c0 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f28012fb700 1 -- 172.21.15.5:0/1628424067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec004390 con 0x7f27fc06a1c0 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f28012fb700 1 -- 172.21.15.5:0/1628424067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0036a0 con 0x7f27fc06a1c0 2023-08-09T14:16:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 -- 172.21.15.5:0/1628424067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 msgr2=0x7f27fc06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 --2- 172.21.15.5:0/1628424067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc06a640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f27fc071260 tx=0x7f27ec009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 -- 172.21.15.5:0/1628424067 shutdown_connections 2023-08-09T14:16:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 --2- 172.21.15.5:0/1628424067 >> v2:172.21.15.101:3300/0 conn(0x7f27fc15d400 0x7f27fc0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 --2- 172.21.15.5:0/1628424067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc06a640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 -- 172.21.15.5:0/1628424067 >> 172.21.15.5:0/1628424067 conn(0x7f27fc0b1900 msgr2=0x7f27fc0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 -- 172.21.15.5:0/1628424067 shutdown_connections 2023-08-09T14:16:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.293+0000 7f2804561700 1 -- 172.21.15.5:0/1628424067 wait complete. 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.295+0000 7f2804561700 1 Processor -- start 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.295+0000 7f2804561700 1 -- start start 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27fc06cd50 0x7f27fc0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27fc15d400 0x7f27fc0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0c38a0 con 0x7f27fc06a1c0 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0c4140 con 0x7f27fc15d400 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2804561700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0c5b20 con 0x7f27fc06cd50 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44434/0 (socket says 172.21.15.5:44434) 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 -- 172.21.15.5:0/4279531593 learned_addr learned my addr 172.21.15.5:0/4279531593 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2801afc700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27fc06cd50 0x7f27fc0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f2802afe700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27fc15d400 0x7f27fc0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 -- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27fc06cd50 msgr2=0x7f27fc0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27fc06cd50 0x7f27fc0c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 -- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27fc15d400 msgr2=0x7f27fc0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27fc15d400 0x7f27fc0c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 -- 172.21.15.5:0/4279531593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009550 con 0x7f27fc06a1c0 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.296+0000 7f28022fd700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f27f800d830 tx=0x7f27f800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.297+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80125f0 con 0x7f27fc06a1c0 2023-08-09T14:16:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.297+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f8012750 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.297+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8012b00 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.297+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc0c3af0 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.297+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc0c3190 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.298+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc074600 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.298+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27f8012c60 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.299+0000 7f27f2ffd700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.299+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f27f8088640 con 0x7f27fc06a1c0 2023-08-09T14:16:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.299+0000 7f2801afc700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.299+0000 7f2801afc700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 0x7f27e006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009130 tx=0x7f27ec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.303+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f27f8054080 con 0x7f27fc06a1c0 2023-08-09T14:16:21.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.584+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f27fc0cc560 con 0x7f27fc06a1c0 2023-08-09T14:16:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.588+0000 7f27f2ffd700 1 -- 172.21.15.5:0/4279531593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f27f80576a0 con 0x7f27fc06a1c0 2023-08-09T14:16:21.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 msgr2=0x7f27e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 0x7f27e006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009130 tx=0x7f27ec008030 comp rx=0 tx=0).stop 2023-08-09T14:16:21.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 msgr2=0x7f27fc158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f27f800d830 tx=0x7f27f800dbf0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 shutdown_connections 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f27fc15d400 0x7f27fc0c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27fc06a1c0 0x7f27fc158640 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 --2- 172.21.15.5:0/4279531593 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f27fc06cd50 0x7f27fc0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 >> 172.21.15.5:0/4279531593 conn(0x7f27fc0b1900 msgr2=0x7f27fc15b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 shutdown_connections 2023-08-09T14:16:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.590+0000 7f2804561700 1 -- 172.21.15.5:0/4279531593 wait complete. 2023-08-09T14:16:21.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-09T14:16:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.728+0000 7f9f4941a700 1 Processor -- start 2023-08-09T14:16:21.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.728+0000 7f9f4941a700 1 -- start start 2023-08-09T14:16:21.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f4941a700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f9f440b1500 0x7f9f441682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f4941a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440d0760 con 0x7f9f440b2130 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f4941a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440ce7f0 con 0x7f9f4415d5d0 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f4941a700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440b00d0 con 0x7f9f440b1500 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f427fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f440b2130 0x7f9f440d16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57860/0 (socket says 172.21.15.5:57860) 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f427fc700 1 -- 172.21.15.5:0/2103519231 learned_addr learned my addr 172.21.15.5:0/2103519231 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2103519231 >> v2:172.21.15.101:3300/0 conn(0x7f9f440b1500 0x7f9f441682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779023772 0 0) 0x7f9f440d0760 con 0x7f9f440b2130 2023-08-09T14:16:21.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c0035b0 con 0x7f9f440b2130 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208079979 0 0) 0x7f9f2c0035b0 con 0x7f9f440b2130 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 >> v2:172.21.15.101:3300/0 conn(0x7f9f440b1500 msgr2=0x7f9f441682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 --2- 172.21.15.5:0/2103519231 >> v2:172.21.15.101:3300/0 conn(0x7f9f440b1500 0x7f9f441682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 >> v1:172.21.15.101:6789/0 conn(0x7f9f4415d5d0 legacy=0x7f9f440d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440afd60 con 0x7f9f440b2130 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.729+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f9f34001670 con 0x7f9f440b2130 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 >> v1:172.21.15.5:6789/0 conn(0x7f9f440b2130 legacy=0x7f9f440d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c003a00 0x7f9f2c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f2c004850 0x7f9f2c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 0x7f9f2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b00d0 con 0x7f9f2c005210 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c00c0b0 con 0x7f9f2c003a00 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c00c270 con 0x7f9f2c004850 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 0x7f9f2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f42ffd700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c003a00 0x7f9f2c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f427fc700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f2c004850 0x7f9f2c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 -- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f2c004850 msgr2=0x7f9f2c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f2c004850 0x7f9f2c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 -- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c003a00 msgr2=0x7f9f2c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c003a00 0x7f9f2c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 -- 172.21.15.5:0/2103519231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0035b0 con 0x7f9f2c005210 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 -- 172.21.15.5:0/2103519231 reap_dead start 2023-08-09T14:16:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 0x7f9f2c00ba10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009fc0 tx=0x7f9f2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7493352406c0883a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003a20 con 0x7f9f2c005210 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00f040 con 0x7f9f2c005210 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.730+0000 7f9f41ffb700 1 -- 172.21.15.5:0/2103519231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003de0 con 0x7f9f2c005210 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 -- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 msgr2=0x7f9f2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 0x7f9f2c00ba10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009fc0 tx=0x7f9f2c005880 comp rx=0 tx=0).stop 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 -- 172.21.15.5:0/2103519231 shutdown_connections 2023-08-09T14:16:21.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2103519231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f2c005210 0x7f9f2c00ba10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 -- 172.21.15.5:0/2103519231 >> 172.21.15.5:0/2103519231 conn(0x7f9f440d3090 msgr2=0x7f9f440d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 -- 172.21.15.5:0/2103519231 shutdown_connections 2023-08-09T14:16:21.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.731+0000 7f9f4941a700 1 -- 172.21.15.5:0/2103519231 wait complete. 2023-08-09T14:16:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.733+0000 7f9f4941a700 1 Processor -- start 2023-08-09T14:16:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.733+0000 7f9f4941a700 1 -- start start 2023-08-09T14:16:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 0x7f9f44158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 0x7f9f4415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4415aff0 con 0x7f9f4415ab80 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b7180 con 0x7f9f2c005210 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f4941a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b7460 con 0x7f9f441e74b0 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44458/0 (socket says 172.21.15.5:44458) 2023-08-09T14:16:21.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 -- 172.21.15.5:0/2891881377 learned_addr learned my addr 172.21.15.5:0/2891881377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f427fc700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 0x7f9f4415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f42ffd700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 0x7f9f44158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 -- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 msgr2=0x7f9f4415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 0x7f9f4415a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 -- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 msgr2=0x7f9f44158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 0x7f9f44158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 -- 172.21.15.5:0/2891881377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440b7740 con 0x7f9f4415ab80 2023-08-09T14:16:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f427fc700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 0x7f9f4415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f42ffd700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 0x7f9f44158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.734+0000 7f9f437fe700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b5c80 tx=0x7f9f3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003e10 con 0x7f9f4415ab80 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c004230 con 0x7f9f4415ab80 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440b7a20 con 0x7f9f4415ab80 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0043e0 con 0x7f9f4415ab80 2023-08-09T14:16:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440b7fe0 con 0x7f9f4415ab80 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.735+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440d2c90 con 0x7f9f4415ab80 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.736+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9f3c004540 con 0x7f9f4415ab80 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.737+0000 7f9f2b7fe700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 0x7f9f3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.737+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9f3c0897e0 con 0x7f9f4415ab80 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.737+0000 7f9f42ffd700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 0x7f9f3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.737+0000 7f9f42ffd700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 0x7f9f3006c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:21.741+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9f3c0552b0 con 0x7f9f4415ab80 2023-08-09T14:16:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.026+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f9f44074600 con 0x7f9f4415ab80 2023-08-09T14:16:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.029+0000 7f9f2b7fe700 1 -- 172.21.15.5:0/2891881377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9f3c0588d0 con 0x7f9f4415ab80 2023-08-09T14:16:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 msgr2=0x7f9f3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 0x7f9f3006c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2023-08-09T14:16:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 msgr2=0x7f9f440b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b5c80 tx=0x7f9f3c009750 comp rx=0 tx=0).stop 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 shutdown_connections 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f9f3006a0e0 0x7f9f3006c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f4415ab80 0x7f9f440b5cb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f9f2c005210 0x7f9f44158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 --2- 172.21.15.5:0/2891881377 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f9f441e74b0 0x7f9f4415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 >> 172.21.15.5:0/2891881377 conn(0x7f9f440d3090 msgr2=0x7f9f4415beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.031+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 shutdown_connections 2023-08-09T14:16:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.032+0000 7f9f4941a700 1 -- 172.21.15.5:0/2891881377 wait complete. 2023-08-09T14:16:22.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-09T14:16:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.169+0000 7fbd6ddca700 1 Processor -- start 2023-08-09T14:16:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.169+0000 7fbd6ddca700 1 -- start start 2023-08-09T14:16:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd6ddca700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 0x7fbd68065f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd6ddca700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd6ddca700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd680722b0 con 0x7fbd680ca0f0 2023-08-09T14:16:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd6ddca700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd680ca560 con 0x7fbd6815b320 2023-08-09T14:16:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd6ddca700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680cbde0 con 0x7fbd680c6630 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd66ffd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd66ffd700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3301/0 says I am v2:172.21.15.5:34048/0 (socket says 172.21.15.5:34048) 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd66ffd700 1 -- 172.21.15.5:0/3837901766 learned_addr learned my addr 172.21.15.5:0/3837901766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.170+0000 7fbd677fe700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 0x7fbd68065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd667fc700 1 -- 172.21.15.5:0/3837901766 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375691732 0 0) 0x7fbd680722b0 con 0x7fbd680ca0f0 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd667fc700 1 -- 172.21.15.5:0/3837901766 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd540035b0 con 0x7fbd680ca0f0 2023-08-09T14:16:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd66ffd700 1 -- 172.21.15.5:0/3837901766 >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 msgr2=0x7fbd68065f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/3837901766 >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 0x7fbd68065f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd66ffd700 1 -- 172.21.15.5:0/3837901766 >> v1:172.21.15.101:6789/0 conn(0x7fbd680ca0f0 legacy=0x7fbd6806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd66ffd700 1 -- 172.21.15.5:0/3837901766 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68072520 con 0x7fbd680c6630 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd677fe700 1 --2- 172.21.15.5:0/3837901766 >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 0x7fbd68065f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/3837901766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd500098f0 tx=0x7fbd50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46eb9b9710ef61a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd667fc700 1 -- 172.21.15.5:0/3837901766 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011830 con 0x7fbd680c6630 2023-08-09T14:16:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd667fc700 1 -- 172.21.15.5:0/3837901766 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50011990 con 0x7fbd680c6630 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.171+0000 7fbd667fc700 1 -- 172.21.15.5:0/3837901766 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011d00 con 0x7fbd680c6630 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 -- 172.21.15.5:0/3837901766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 msgr2=0x7fbd680c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/3837901766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd500098f0 tx=0x7fbd50009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 -- 172.21.15.5:0/3837901766 shutdown_connections 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/3837901766 >> v2:172.21.15.101:3300/0 conn(0x7fbd6815b320 0x7fbd68065f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/3837901766 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd680c6630 0x7fbd680c9bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 -- 172.21.15.5:0/3837901766 >> 172.21.15.5:0/3837901766 conn(0x7fbd680cf560 msgr2=0x7fbd680cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 -- 172.21.15.5:0/3837901766 shutdown_connections 2023-08-09T14:16:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.172+0000 7fbd6ddca700 1 -- 172.21.15.5:0/3837901766 wait complete. 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.173+0000 7fbd6ddca700 1 Processor -- start 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.173+0000 7fbd6ddca700 1 -- start start 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 0x7fbd680caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 0x7fbd680cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd681552b0 con 0x7fbd680c6630 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680c5350 con 0x7fbd680ca0f0 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd6ddca700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680c5630 con 0x7fbd6815b320 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44468/0 (socket says 172.21.15.5:44468) 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 -- 172.21.15.5:0/2399248598 learned_addr learned my addr 172.21.15.5:0/2399248598 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 0x7fbd680caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd67fff700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 0x7fbd680cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 -- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 msgr2=0x7fbd680cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 0x7fbd680cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 -- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 msgr2=0x7fbd680caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 0x7fbd680caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 -- 172.21.15.5:0/2399248598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580094a0 con 0x7fbd680c6630 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd67fff700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 0x7fbd680cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 0x7fbd680caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.174+0000 7fbd677fe700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ebe0 tx=0x7fbd58009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.175+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800c910 con 0x7fbd680c6630 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.175+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50009550 con 0x7fbd680c6630 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.175+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd680c5bf0 con 0x7fbd680c6630 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.175+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800ca70 con 0x7fbd680c6630 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.175+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800cde0 con 0x7fbd680c6630 2023-08-09T14:16:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.176+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd58013470 con 0x7fbd680c6630 2023-08-09T14:16:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.176+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68074600 con 0x7fbd680c6630 2023-08-09T14:16:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.176+0000 7fbd5ffff700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 0x7fbd4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.177+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbd58088760 con 0x7fbd680c6630 2023-08-09T14:16:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.177+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 0x7fbd4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.177+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 0x7fbd4806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd680c9f50 tx=0x7fbd50008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.181+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbd58054120 con 0x7fbd680c6630 2023-08-09T14:16:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.462+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbd680cd130 con 0x7fbd680c6630 2023-08-09T14:16:22.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.465+0000 7fbd5ffff700 1 -- 172.21.15.5:0/2399248598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbd58057740 con 0x7fbd680c6630 2023-08-09T14:16:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 msgr2=0x7fbd4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 0x7fbd4806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd680c9f50 tx=0x7fbd50008030 comp rx=0 tx=0).stop 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 msgr2=0x7fbd68154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ebe0 tx=0x7fbd58009ec0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 shutdown_connections 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fbd4806a0e0 0x7fbd4806c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fbd6815b320 0x7fbd680cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680c6630 0x7fbd68154d70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 --2- 172.21.15.5:0/2399248598 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fbd680ca0f0 0x7fbd680caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 >> 172.21.15.5:0/2399248598 conn(0x7fbd680cf560 msgr2=0x7fbd680b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 shutdown_connections 2023-08-09T14:16:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.467+0000 7fbd6ddca700 1 -- 172.21.15.5:0/2399248598 wait complete. 2023-08-09T14:16:22.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-09T14:16:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.605+0000 7f5ca914e700 1 Processor -- start 2023-08-09T14:16:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.605+0000 7f5ca914e700 1 -- start start 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca914e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca40ca2c0 0x7f5ca4065f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca914e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f5ca40c6630 0x7f5ca40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca914e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40c6a10 con 0x7f5ca415b320 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca914e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40722b0 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca914e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca4072520 con 0x7f5ca40c6630 2023-08-09T14:16:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca40ca2c0 0x7f5ca4065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca40ca2c0 0x7f5ca4065f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44478/0 (socket says 172.21.15.5:44478) 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 -- 172.21.15.5:0/1654929104 learned_addr learned my addr 172.21.15.5:0/1654929104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca359e700 1 --2- 172.21.15.5:0/1654929104 >> v2:172.21.15.101:3300/0 conn(0x7f5ca40c6630 0x7f5ca40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 -- 172.21.15.5:0/1654929104 >> v2:172.21.15.101:3300/0 conn(0x7f5ca40c6630 msgr2=0x7f5ca40cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 --2- 172.21.15.5:0/1654929104 >> v2:172.21.15.101:3300/0 conn(0x7f5ca40c6630 0x7f5ca40cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 -- 172.21.15.5:0/1654929104 >> v1:172.21.15.101:6789/0 conn(0x7f5ca415b320 legacy=0x7f5ca40c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 -- 172.21.15.5:0/1654929104 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40705b0 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca259c700 1 --2- 172.21.15.5:0/1654929104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca40ca2c0 0x7f5ca4065f50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40d05b0 tx=0x7f5c94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c099359692b8d70d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.606+0000 7f5ca1d9b700 1 -- 172.21.15.5:0/1654929104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94004230 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca1d9b700 1 -- 172.21.15.5:0/1654929104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94004390 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca1d9b700 1 -- 172.21.15.5:0/1654929104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940036a0 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 -- 172.21.15.5:0/1654929104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca40ca2c0 msgr2=0x7f5ca4065f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1654929104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca40ca2c0 0x7f5ca4065f50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40d05b0 tx=0x7f5c94009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 -- 172.21.15.5:0/1654929104 shutdown_connections 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1654929104 >> v2:172.21.15.101:3300/0 conn(0x7f5ca40c6630 0x7f5ca40cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1654929104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca40ca2c0 0x7f5ca4065f50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 -- 172.21.15.5:0/1654929104 >> 172.21.15.5:0/1654929104 conn(0x7f5ca40cf560 msgr2=0x7f5ca40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 -- 172.21.15.5:0/1654929104 shutdown_connections 2023-08-09T14:16:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.607+0000 7f5ca914e700 1 -- 172.21.15.5:0/1654929104 wait complete. 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 Processor -- start 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 -- start start 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ca40c6630 0x7f5ca41573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ca40ca2c0 0x7f5ca41f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c4340 con 0x7f5ca415b320 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c3aa0 con 0x7f5ca40c6630 2023-08-09T14:16:22.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.609+0000 7f5ca914e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca415a6e0 con 0x7f5ca40ca2c0 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44486/0 (socket says 172.21.15.5:44486) 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 -- 172.21.15.5:0/1130003993 learned_addr learned my addr 172.21.15.5:0/1130003993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca2d9d700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ca40c6630 0x7f5ca41573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca259c700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ca40ca2c0 0x7f5ca41f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 -- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ca40ca2c0 msgr2=0x7f5ca41f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ca40ca2c0 0x7f5ca41f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 -- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ca40c6630 msgr2=0x7f5ca41573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ca40c6630 0x7f5ca41573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 -- 172.21.15.5:0/1130003993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009550 con 0x7f5ca415b320 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca359e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007e40 tx=0x7f5c9c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00ed30 con 0x7f5ca415b320 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c014420 con 0x7f5ca415b320 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca4157a80 con 0x7f5ca415b320 2023-08-09T14:16:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0147d0 con 0x7f5ca415b320 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.610+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca40c3fd0 con 0x7f5ca415b320 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.611+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4074600 con 0x7f5ca415b320 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.612+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c9c014930 con 0x7f5ca415b320 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.612+0000 7f5c8b7fe700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 0x7f5c9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.612+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5c9c0887e0 con 0x7f5ca415b320 2023-08-09T14:16:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.612+0000 7f5ca2d9d700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 0x7f5c9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:22.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.613+0000 7f5ca2d9d700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 0x7f5c9006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009960 tx=0x7f5c980090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:22.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.616+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5c9c0542b0 con 0x7f5ca415b320 2023-08-09T14:16:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.901+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5ca40cadd0 con 0x7f5ca415b320 2023-08-09T14:16:22.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.903+0000 7f5c8b7fe700 1 -- 172.21.15.5:0/1130003993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c9c0578d0 con 0x7f5ca415b320 2023-08-09T14:16:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 msgr2=0x7f5c9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 0x7f5c9006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009960 tx=0x7f5c980090e0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 msgr2=0x7f5ca40c4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007e40 tx=0x7f5c9c00e3c0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 shutdown_connections 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5c9006a0e0 0x7f5c9006c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415b320 0x7f5ca40c4830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5ca40c6630 0x7f5ca41573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 --2- 172.21.15.5:0/1130003993 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5ca40ca2c0 0x7f5ca41f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 >> 172.21.15.5:0/1130003993 conn(0x7f5ca40cf560 msgr2=0x7f5ca40cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 shutdown_connections 2023-08-09T14:16:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:22.906+0000 7f5ca914e700 1 -- 172.21.15.5:0/1130003993 wait complete. 2023-08-09T14:16:22.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-09T14:16:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.043+0000 7feafd410700 1 Processor -- start 2023-08-09T14:16:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 -- start start 2023-08-09T14:16:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 0x7feaf80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80d0760 con 0x7feaf815d5d0 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80b00d0 con 0x7feaf80b2130 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.044+0000 7feafd410700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80ce7f0 con 0x7feaf80b04f0 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf67fc700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 0x7feaf80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf67fc700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.101:3300/0 says I am v2:172.21.15.5:33304/0 (socket says 172.21.15.5:33304) 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf6ffd700 1 --1- >> v1:172.21.15.101:6789/0 conn(0x7feaf815d5d0 0x7feaf80d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.101:6789/0 says I am v1:172.21.15.5:39252/0 (socket says 172.21.15.5:39252) 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf67fc700 1 -- 172.21.15.5:0/3208157075 learned_addr learned my addr 172.21.15.5:0/3208157075 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 -- 172.21.15.5:0/3208157075 >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 msgr2=0x7feaf80d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 --2- 172.21.15.5:0/3208157075 >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 -- 172.21.15.5:0/3208157075 >> v1:172.21.15.101:6789/0 conn(0x7feaf815d5d0 legacy=0x7feaf80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 -- 172.21.15.5:0/3208157075 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80afd60 con 0x7feaf80b04f0 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf5ffb700 1 -- 172.21.15.5:0/3208157075 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561741907 0 0) 0x7feaf80d0760 con 0x7feaf815d5d0 2023-08-09T14:16:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf67fc700 1 --2- 172.21.15.5:0/3208157075 >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf77fe700 1 --2- 172.21.15.5:0/3208157075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 0x7feaf80b0940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009d90 tx=0x7feaf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7699d0b2fe43aea4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf5ffb700 1 -- 172.21.15.5:0/3208157075 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000e070 con 0x7feaf80b04f0 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf5ffb700 1 -- 172.21.15.5:0/3208157075 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000bb20 con 0x7feaf80b04f0 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.045+0000 7feaf5ffb700 1 -- 172.21.15.5:0/3208157075 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0012430 con 0x7feaf80b04f0 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 -- 172.21.15.5:0/3208157075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 msgr2=0x7feaf80b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 --2- 172.21.15.5:0/3208157075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 0x7feaf80b0940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009d90 tx=0x7feaf000b330 comp rx=0 tx=0).stop 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 -- 172.21.15.5:0/3208157075 shutdown_connections 2023-08-09T14:16:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 --2- 172.21.15.5:0/3208157075 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80b04f0 0x7feaf80b0940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 --2- 172.21.15.5:0/3208157075 >> v2:172.21.15.101:3300/0 conn(0x7feaf80b2130 0x7feaf80d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 -- 172.21.15.5:0/3208157075 >> 172.21.15.5:0/3208157075 conn(0x7feaf80d3090 msgr2=0x7feaf80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 -- 172.21.15.5:0/3208157075 shutdown_connections 2023-08-09T14:16:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.046+0000 7feafd410700 1 -- 172.21.15.5:0/3208157075 wait complete. 2023-08-09T14:16:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.047+0000 7feafd410700 1 Processor -- start 2023-08-09T14:16:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.047+0000 7feafd410700 1 -- start start 2023-08-09T14:16:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80b04f0 0x7feaf8149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815d5d0 0x7feaf80ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80cced0 con 0x7feaf80b2130 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80caa60 con 0x7feaf80b04f0 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feafd410700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80b4280 con 0x7feaf815d5d0 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feaf67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feaf67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44500/0 (socket says 172.21.15.5:44500) 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feaf67fc700 1 -- 172.21.15.5:0/650010476 learned_addr learned my addr 172.21.15.5:0/650010476 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feaf6ffd700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80b04f0 0x7feaf8149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.048+0000 7feaf77fe700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815d5d0 0x7feaf80ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 -- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815d5d0 msgr2=0x7feaf80ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815d5d0 0x7feaf80ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 -- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80b04f0 msgr2=0x7feaf8149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80b04f0 0x7feaf8149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 -- 172.21.15.5:0/650010476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009550 con 0x7feaf80b2130 2023-08-09T14:16:23.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feaf67fc700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feae800e980 tx=0x7feae800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800c690 con 0x7feaf80b2130 2023-08-09T14:16:23.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800c7f0 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf0009a70 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800cb60 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.049+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80b3c30 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.050+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf80d38c0 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.050+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feae800ccc0 con 0x7feaf80b2130 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.051+0000 7feadf7fe700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 0x7feae406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.051+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feae8088170 con 0x7feaf80b2130 2023-08-09T14:16:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.051+0000 7feaf6ffd700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 0x7feae406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.052+0000 7feaf6ffd700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 0x7feae406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feaec007fd0 tx=0x7feaec007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.055+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feae8053bc0 con 0x7feaf80b2130 2023-08-09T14:16:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.338+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7feaf8074600 con 0x7feaf80b2130 2023-08-09T14:16:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.342+0000 7feadf7fe700 1 -- 172.21.15.5:0/650010476 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7feae80571e0 con 0x7feaf80b2130 2023-08-09T14:16:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 msgr2=0x7feae406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 0x7feae406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feaec007fd0 tx=0x7feaec007de0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 msgr2=0x7feaf80cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feae800e980 tx=0x7feae800ec90 comp rx=0 tx=0).stop 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 shutdown_connections 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feae406a0e0 0x7feae406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815d5d0 0x7feaf80ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80b04f0 0x7feaf8149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 --2- 172.21.15.5:0/650010476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b2130 0x7feaf80cc990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 >> 172.21.15.5:0/650010476 conn(0x7feaf80d3090 msgr2=0x7feaf815dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 shutdown_connections 2023-08-09T14:16:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.344+0000 7feafd410700 1 -- 172.21.15.5:0/650010476 wait complete. 2023-08-09T14:16:23.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.481+0000 7f29c57b2700 1 Processor -- start 2023-08-09T14:16:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 -- start start 2023-08-09T14:16:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c015d5d0 0x7f29c00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f29c00b2130 0x7f29c00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29c00d1a10 0x7f29c00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00b00d0 con 0x7f29c00d1a10 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00ce7f0 con 0x7f29c00b2130 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29c57b2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00afd60 con 0x7f29c015d5d0 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.482+0000 7f29bf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29c00d1a10 0x7f29c00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29c00d1a10 0x7f29c00cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44508/0 (socket says 172.21.15.5:44508) 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 -- 172.21.15.5:0/4132890 learned_addr learned my addr 172.21.15.5:0/4132890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29be7fc700 1 --2- 172.21.15.5:0/4132890 >> v2:172.21.15.101:3300/0 conn(0x7f29c00b2130 0x7f29c00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29beffd700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c015d5d0 0x7f29c00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 -- 172.21.15.5:0/4132890 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c015d5d0 msgr2=0x7f29c00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c015d5d0 0x7f29c00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 -- 172.21.15.5:0/4132890 >> v2:172.21.15.101:3300/0 conn(0x7f29c00b2130 msgr2=0x7f29c00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/4132890 >> v2:172.21.15.101:3300/0 conn(0x7f29c00b2130 0x7f29c00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 -- 172.21.15.5:0/4132890 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00cea40 con 0x7f29c00d1a10 2023-08-09T14:16:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00d1a10 0x7f29c00cf750 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f29c008beb0 tx=0x7f29b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad52df0d021adfbc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bdffb700 1 -- 172.21.15.5:0/4132890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800e070 con 0x7f29c00d1a10 2023-08-09T14:16:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bdffb700 1 -- 172.21.15.5:0/4132890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800b910 con 0x7f29c00d1a10 2023-08-09T14:16:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.483+0000 7f29bdffb700 1 -- 172.21.15.5:0/4132890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800bcc0 con 0x7f29c00d1a10 2023-08-09T14:16:23.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 -- 172.21.15.5:0/4132890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00d1a10 msgr2=0x7f29c00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00d1a10 0x7f29c00cf750 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f29c008beb0 tx=0x7f29b800b330 comp rx=0 tx=0).stop 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 -- 172.21.15.5:0/4132890 shutdown_connections 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00d1a10 0x7f29c00cf750 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 --2- 172.21.15.5:0/4132890 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c015d5d0 0x7f29c00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 --2- 172.21.15.5:0/4132890 >> v2:172.21.15.101:3300/0 conn(0x7f29c00b2130 0x7f29c00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 -- 172.21.15.5:0/4132890 >> 172.21.15.5:0/4132890 conn(0x7f29c00d3090 msgr2=0x7f29c00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 -- 172.21.15.5:0/4132890 shutdown_connections 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.484+0000 7f29c57b2700 1 -- 172.21.15.5:0/4132890 wait complete. 2023-08-09T14:16:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.485+0000 7f29c57b2700 1 Processor -- start 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.485+0000 7f29c57b2700 1 -- start start 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c00b2130 0x7f29c014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 0x7f29c00b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00cc880 con 0x7f29c015d5d0 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00cbc70 con 0x7f29c00d1a10 2023-08-09T14:16:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29c57b2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00cbf50 con 0x7f29c00b2130 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44514/0 (socket says 172.21.15.5:44514) 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 -- 172.21.15.5:0/3988258191 learned_addr learned my addr 172.21.15.5:0/3988258191 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29beffd700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c00b2130 0x7f29c014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29be7fc700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 0x7f29c00b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 -- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c00b2130 msgr2=0x7f29c014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c00b2130 0x7f29c014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 -- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 msgr2=0x7f29c00b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 0x7f29c00b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29bf7fe700 1 -- 172.21.15.5:0/3988258191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009b30 con 0x7f29c015d5d0 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.486+0000 7f29be7fc700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 0x7f29c00b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29bf7fe700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29c008d370 tx=0x7f29b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80099b0 con 0x7f29c015d5d0 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800ce80 con 0x7f29c015d5d0 2023-08-09T14:16:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c00cc230 con 0x7f29c015d5d0 2023-08-09T14:16:23.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8004490 con 0x7f29c015d5d0 2023-08-09T14:16:23.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.487+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c00ccd10 con 0x7f29c015d5d0 2023-08-09T14:16:23.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.488+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c00cca30 con 0x7f29c015d5d0 2023-08-09T14:16:23.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.488+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f29b80045f0 con 0x7f29c015d5d0 2023-08-09T14:16:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.488+0000 7f29a77fe700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 0x7f29ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.489+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f29b8089ac0 con 0x7f29c015d5d0 2023-08-09T14:16:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.489+0000 7f29beffd700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 0x7f29ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.489+0000 7f29beffd700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 0x7f29ac06c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009b40 tx=0x7f29b0009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.493+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f29c00cca30 con 0x7f29c015d5d0 2023-08-09T14:16:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.691+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c0074600 con 0x7f29c015d5d0 2023-08-09T14:16:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.692+0000 7f29a77fe700 1 -- 172.21.15.5:0/3988258191 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14533 (secure 0 0 0) 0x7f29b8089e60 con 0x7f29c015d5d0 2023-08-09T14:16:23.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:23.695 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:20.253609+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 msgr2=0x7f29ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 0x7f29ac06c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009b40 tx=0x7f29b0009210 comp rx=0 tx=0).stop 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 msgr2=0x7f29c00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29c008d370 tx=0x7f29b8004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 shutdown_connections 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f29ac06a0e0 0x7f29ac06c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c015d5d0 0x7f29c00b3440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f29c00b2130 0x7f29c014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 --2- 172.21.15.5:0/3988258191 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f29c00d1a10 0x7f29c00b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.694+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 >> 172.21.15.5:0/3988258191 conn(0x7f29c00d3090 msgr2=0x7f29c01605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.695+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 shutdown_connections 2023-08-09T14:16:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.695+0000 7f29c57b2700 1 -- 172.21.15.5:0/3988258191 wait complete. 2023-08-09T14:16:23.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:16:23.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:16:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.835+0000 7fd78d139700 1 Processor -- start 2023-08-09T14:16:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.835+0000 7fd78d139700 1 -- start start 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78d139700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 0x7fd7880af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78d139700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd78806a1c0 0x7fd78806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78d139700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78806ab50 con 0x7fd78815d3a0 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78d139700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880cd6c0 con 0x7fd78806a1c0 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78d139700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880715a0 con 0x7fd7880cd1c0 2023-08-09T14:16:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78759e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd78806a1c0 0x7fd78806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78759e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd78806a1c0 0x7fd78806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44522/0 (socket says 172.21.15.5:44522) 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78759e700 1 -- 172.21.15.5:0/2144501800 learned_addr learned my addr 172.21.15.5:0/2144501800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78659c700 1 --2- 172.21.15.5:0/2144501800 >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 0x7fd7880af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.836+0000 7fd78759e700 1 -- 172.21.15.5:0/2144501800 >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 msgr2=0x7fd7880af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78759e700 1 --2- 172.21.15.5:0/2144501800 >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 0x7fd7880af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78759e700 1 -- 172.21.15.5:0/2144501800 >> v1:172.21.15.101:6789/0 conn(0x7fd78815d3a0 legacy=0x7fd7880cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78759e700 1 -- 172.21.15.5:0/2144501800 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880712a0 con 0x7fd78806a1c0 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78659c700 1 --2- 172.21.15.5:0/2144501800 >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 0x7fd7880af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78759e700 1 --2- 172.21.15.5:0/2144501800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd78806a610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd788161fa0 tx=0x7fd78000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3533de18eba5b819 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd785d9b700 1 -- 172.21.15.5:0/2144501800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000e070 con 0x7fd78806a1c0 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd785d9b700 1 -- 172.21.15.5:0/2144501800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780003a20 con 0x7fd78806a1c0 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd785d9b700 1 -- 172.21.15.5:0/2144501800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780003dd0 con 0x7fd78806a1c0 2023-08-09T14:16:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 -- 172.21.15.5:0/2144501800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 msgr2=0x7fd78806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 --2- 172.21.15.5:0/2144501800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd78806a610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd788161fa0 tx=0x7fd78000b330 comp rx=0 tx=0).stop 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 -- 172.21.15.5:0/2144501800 shutdown_connections 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 --2- 172.21.15.5:0/2144501800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd78806a610 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 --2- 172.21.15.5:0/2144501800 >> v2:172.21.15.101:3300/0 conn(0x7fd7880cd1c0 0x7fd7880af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 -- 172.21.15.5:0/2144501800 >> 172.21.15.5:0/2144501800 conn(0x7fd7880b1970 msgr2=0x7fd7880b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 -- 172.21.15.5:0/2144501800 shutdown_connections 2023-08-09T14:16:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.837+0000 7fd78d139700 1 -- 172.21.15.5:0/2144501800 wait complete. 2023-08-09T14:16:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.839+0000 7fd78d139700 1 Processor -- start 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.839+0000 7fd78d139700 1 -- start start 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd7880cd1c0 0x7fd7880b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd78815d3a0 0x7fd78815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c5d40 con 0x7fd78806a1c0 2023-08-09T14:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c5a60 con 0x7fd7880cd1c0 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78d139700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78815d8b0 con 0x7fd78815d3a0 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44524/0 (socket says 172.21.15.5:44524) 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 -- 172.21.15.5:0/1172289336 learned_addr learned my addr 172.21.15.5:0/1172289336 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd78659c700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd7880cd1c0 0x7fd7880b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 -- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd78815d3a0 msgr2=0x7fd78815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd78815d3a0 0x7fd78815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 -- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd7880cd1c0 msgr2=0x7fd7880b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd7880cd1c0 0x7fd7880b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 -- 172.21.15.5:0/1172289336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780009b30 con 0x7fd78806a1c0 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd786d9d700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00b4a0 tx=0x7fd77c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.840+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c011830 con 0x7fd78806a1c0 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.841+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c011990 con 0x7fd78806a1c0 2023-08-09T14:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.841+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78815db90 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.841+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c011d40 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.841+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd788160770 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.841+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78815e0b0 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.842+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd77c01a400 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.842+0000 7fd76f7fe700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 0x7fd77406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.842+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd77c087f30 con 0x7fd78806a1c0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.843+0000 7fd78659c700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 0x7fd77406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.843+0000 7fd78659c700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 0x7fd77406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd778006fd0 tx=0x7fd778008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:23.847+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd77c053a00 con 0x7fd78806a1c0 2023-08-09T14:16:24.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.045+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd788074600 con 0x7fd78806a1c0 2023-08-09T14:16:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.046+0000 7fd76f7fe700 1 -- 172.21.15.5:0/1172289336 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd77c057020 con 0x7fd78806a1c0 2023-08-09T14:16:24.048 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:16:24.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.047+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 msgr2=0x7fd77406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.047+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 0x7fd77406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd778006fd0 tx=0x7fd778008040 comp rx=0 tx=0).stop 2023-08-09T14:16:24.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 msgr2=0x7fd788160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00b4a0 tx=0x7fd77c00b860 comp rx=0 tx=0).stop 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 shutdown_connections 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd77406a0e0 0x7fd77406c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd78815d3a0 0x7fd78815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78806a1c0 0x7fd788160230 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 --2- 172.21.15.5:0/1172289336 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd7880cd1c0 0x7fd7880b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 >> 172.21.15.5:0/1172289336 conn(0x7fd7880b1970 msgr2=0x7fd7880b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 shutdown_connections 2023-08-09T14:16:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.048+0000 7fd78d139700 1 -- 172.21.15.5:0/1172289336 wait complete. 2023-08-09T14:16:24.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:16:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.188+0000 7f10ca589700 1 Processor -- start 2023-08-09T14:16:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.188+0000 7f10ca589700 1 -- start start 2023-08-09T14:16:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10ca589700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 0x7f10c415f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10ca589700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10c40b2ff0 0x7f10c4151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10ca589700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40cf500 con 0x7f10c40cb4b0 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10ca589700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c415fc90 con 0x7f10c40b2ff0 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10ca589700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40cf990 con 0x7f10c40b6170 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10c40cb4b0 0x7f10c40b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57948/0 (socket says 172.21.15.5:57948) 2023-08-09T14:16:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c8b26700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10c40b2ff0 0x7f10c4151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c37fe700 1 -- 172.21.15.5:0/4012260241 learned_addr learned my addr 172.21.15.5:0/4012260241 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c3fff700 1 --2- 172.21.15.5:0/4012260241 >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 0x7f10c415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c8b26700 1 -- 172.21.15.5:0/4012260241 >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 msgr2=0x7f10c415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c8b26700 1 --2- 172.21.15.5:0/4012260241 >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 0x7f10c415f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c8b26700 1 -- 172.21.15.5:0/4012260241 >> v1:172.21.15.5:6789/0 conn(0x7f10c40cb4b0 legacy=0x7f10c40b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c2ffd700 1 -- 172.21.15.5:0/4012260241 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084669051 0 0) 0x7f10c40cf500 con 0x7f10c40cb4b0 2023-08-09T14:16:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c8b26700 1 -- 172.21.15.5:0/4012260241 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40cb910 con 0x7f10c40b2ff0 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.189+0000 7f10c3fff700 1 --2- 172.21.15.5:0/4012260241 >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 0x7f10c415f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10c8b26700 1 --2- 172.21.15.5:0/4012260241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40b2ff0 0x7f10c4151a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10c40ce9e0 tx=0x7f10bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c2937a25b8b719 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10c2ffd700 1 -- 172.21.15.5:0/4012260241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00e070 con 0x7f10c40b2ff0 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10c2ffd700 1 -- 172.21.15.5:0/4012260241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00bb90 con 0x7f10c40b2ff0 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10c2ffd700 1 -- 172.21.15.5:0/4012260241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc012430 con 0x7f10c40b2ff0 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 -- 172.21.15.5:0/4012260241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40b2ff0 msgr2=0x7f10c4151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 --2- 172.21.15.5:0/4012260241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40b2ff0 0x7f10c4151a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10c40ce9e0 tx=0x7f10bc00b330 comp rx=0 tx=0).stop 2023-08-09T14:16:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 -- 172.21.15.5:0/4012260241 shutdown_connections 2023-08-09T14:16:24.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 --2- 172.21.15.5:0/4012260241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40b2ff0 0x7f10c4151a20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 --2- 172.21.15.5:0/4012260241 >> v2:172.21.15.101:3300/0 conn(0x7f10c40b6170 0x7f10c415f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 -- 172.21.15.5:0/4012260241 >> 172.21.15.5:0/4012260241 conn(0x7f10c406dec0 msgr2=0x7f10c406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 -- 172.21.15.5:0/4012260241 shutdown_connections 2023-08-09T14:16:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.190+0000 7f10ca589700 1 -- 172.21.15.5:0/4012260241 wait complete. 2023-08-09T14:16:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 Processor -- start 2023-08-09T14:16:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 -- start start 2023-08-09T14:16:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 0x7f10c415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10c40b6170 0x7f10c4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4157890 con 0x7f10c40cb4b0 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41f13b0 con 0x7f10c40b2ff0 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.192+0000 7f10ca589700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41f1650 con 0x7f10c40b6170 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44542/0 (socket says 172.21.15.5:44542) 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 -- 172.21.15.5:0/1856093105 learned_addr learned my addr 172.21.15.5:0/1856093105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c3fff700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 0x7f10c415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c37fe700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10c40b6170 0x7f10c4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 -- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10c40b6170 msgr2=0x7f10c4155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10c40b6170 0x7f10c4155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 -- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 msgr2=0x7f10c415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 0x7f10c415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 -- 172.21.15.5:0/1856093105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009a70 con 0x7f10c40cb4b0 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c3fff700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 0x7f10c415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c8b26700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10bc014040 tx=0x7f10bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01b810 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc020070 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c41f1930 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01bbb0 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.193+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41f1ef0 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.194+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4074600 con 0x7f10c40cb4b0 2023-08-09T14:16:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.195+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10bc01bd10 con 0x7f10c40cb4b0 2023-08-09T14:16:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.195+0000 7f10c0ff9700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 0x7f10a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.195+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f10bc022070 con 0x7f10c40cb4b0 2023-08-09T14:16:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.195+0000 7f10c3fff700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 0x7f10a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.196+0000 7f10c3fff700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 0x7f10a406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10c40b5b00 tx=0x7f10ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.200+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f10bc059f30 con 0x7f10c40cb4b0 2023-08-09T14:16:24.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.399+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10c406fe90 con 0x7f10c40cb4b0 2023-08-09T14:16:24.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.400+0000 7f10c0ff9700 1 -- 172.21.15.5:0/1856093105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10bc059ac0 con 0x7f10c40cb4b0 2023-08-09T14:16:24.402 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:16:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 msgr2=0x7f10a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 0x7f10a406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10c40b5b00 tx=0x7f10ac008040 comp rx=0 tx=0).stop 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 msgr2=0x7f10c4152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10bc014040 tx=0x7f10bc004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 shutdown_connections 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f10a406a0e0 0x7f10a406c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c40cb4b0 0x7f10c4152260 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f10c40b2ff0 0x7f10c415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 --2- 172.21.15.5:0/1856093105 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f10c40b6170 0x7f10c4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 >> 172.21.15.5:0/1856093105 conn(0x7f10c406dec0 msgr2=0x7f10c4153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 shutdown_connections 2023-08-09T14:16:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.402+0000 7f10ca589700 1 -- 172.21.15.5:0/1856093105 wait complete. 2023-08-09T14:16:24.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T14:16:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.538+0000 7f912c423700 1 Processor -- start 2023-08-09T14:16:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.538+0000 7f912c423700 1 -- start start 2023-08-09T14:16:24.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f912c423700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91240d1c20 0x7f91240d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f912c423700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240d0750 con 0x7f912415d720 2023-08-09T14:16:24.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f912c423700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240ce100 con 0x7f912415d340 2023-08-09T14:16:24.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f912c423700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240d1370 con 0x7f91240d1c20 2023-08-09T14:16:24.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f912a9c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91240d1c20 0x7f91240d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f91299be700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f912415d720 0x7f91240d1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57964/0 (socket says 172.21.15.5:57964) 2023-08-09T14:16:24.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.539+0000 7f91299be700 1 -- 172.21.15.5:0/2619179749 learned_addr learned my addr 172.21.15.5:0/2619179749 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:24.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912a9c0700 1 -- 172.21.15.5:0/2619179749 >> v1:172.21.15.101:6789/0 conn(0x7f912415d340 legacy=0x7f91240b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912a9c0700 1 -- 172.21.15.5:0/2619179749 >> v1:172.21.15.5:6789/0 conn(0x7f912415d720 legacy=0x7f91240d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f91291bd700 1 -- 172.21.15.5:0/2619179749 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991388307 0 0) 0x7f91240d0750 con 0x7f912415d720 2023-08-09T14:16:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912a9c0700 1 -- 172.21.15.5:0/2619179749 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240ce3e0 con 0x7f91240d1c20 2023-08-09T14:16:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912a9c0700 1 --2- 172.21.15.5:0/2619179749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240d1c20 0x7f91240d0e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9114009d90 tx=0x7f911400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8e353e465c2793 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f91291bd700 1 -- 172.21.15.5:0/2619179749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400e070 con 0x7f91240d1c20 2023-08-09T14:16:24.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f91291bd700 1 -- 172.21.15.5:0/2619179749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400bbd0 con 0x7f91240d1c20 2023-08-09T14:16:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f91291bd700 1 -- 172.21.15.5:0/2619179749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114012430 con 0x7f91240d1c20 2023-08-09T14:16:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912c423700 1 -- 172.21.15.5:0/2619179749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240d1c20 msgr2=0x7f91240d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.540+0000 7f912c423700 1 --2- 172.21.15.5:0/2619179749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240d1c20 0x7f91240d0e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9114009d90 tx=0x7f911400b330 comp rx=0 tx=0).stop 2023-08-09T14:16:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.541+0000 7f912c423700 1 -- 172.21.15.5:0/2619179749 shutdown_connections 2023-08-09T14:16:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.541+0000 7f912c423700 1 --2- 172.21.15.5:0/2619179749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240d1c20 0x7f91240d0e30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.541+0000 7f912c423700 1 -- 172.21.15.5:0/2619179749 >> 172.21.15.5:0/2619179749 conn(0x7f91240d2f30 msgr2=0x7f91240d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.541+0000 7f912c423700 1 -- 172.21.15.5:0/2619179749 shutdown_connections 2023-08-09T14:16:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.541+0000 7f912c423700 1 -- 172.21.15.5:0/2619179749 wait complete. 2023-08-09T14:16:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.542+0000 7f912c423700 1 Processor -- start 2023-08-09T14:16:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.542+0000 7f912c423700 1 -- start start 2023-08-09T14:16:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f91240d1c20 0x7f91241f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f912415d720 0x7f91240c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c6a60 con 0x7f912415d340 2023-08-09T14:16:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91241f6220 con 0x7f912415d720 2023-08-09T14:16:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f912c423700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c6fe0 con 0x7f91240d1c20 2023-08-09T14:16:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f91299be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f91299be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44554/0 (socket says 172.21.15.5:44554) 2023-08-09T14:16:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.543+0000 7f91299be700 1 -- 172.21.15.5:0/926119777 learned_addr learned my addr 172.21.15.5:0/926119777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f912a9c0700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f912415d720 0x7f91240c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f912a1bf700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f91240d1c20 0x7f91241f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 -- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f91240d1c20 msgr2=0x7f91241f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f91240d1c20 0x7f91241f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 -- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f912415d720 msgr2=0x7f91240c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f912415d720 0x7f91240c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 -- 172.21.15.5:0/926119777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009a70 con 0x7f912415d340 2023-08-09T14:16:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f91299be700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9118001eb0 tx=0x7f911800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118004c80 con 0x7f912415d340 2023-08-09T14:16:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118004de0 con 0x7f912415d340 2023-08-09T14:16:24.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118007310 con 0x7f912415d340 2023-08-09T14:16:24.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91240b8010 con 0x7f912415d340 2023-08-09T14:16:24.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.544+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91240c6c70 con 0x7f912415d340 2023-08-09T14:16:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.545+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91240b8530 con 0x7f912415d340 2023-08-09T14:16:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.545+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9118007470 con 0x7f912415d340 2023-08-09T14:16:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.546+0000 7f9122ffd700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 0x7f911006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.546+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9118087ef0 con 0x7f912415d340 2023-08-09T14:16:24.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.546+0000 7f912a1bf700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 0x7f911006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.546+0000 7f912a1bf700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 0x7f911006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f911c000fb0 tx=0x7f911c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.550+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9118053930 con 0x7f912415d340 2023-08-09T14:16:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.754+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9124074600 con 0x7f912415d340 2023-08-09T14:16:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.754+0000 7f9122ffd700 1 -- 172.21.15.5:0/926119777 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9118056f50 con 0x7f912415d340 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-08-09T14:16:24.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-08-09T14:16:24.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-08-09T14:16:24.759 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-08-09T14:16:24.759 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-08-09T14:16:24.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-08-09T14:16:24.759 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-08-09T14:16:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 msgr2=0x7f911006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 0x7f911006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f911c000fb0 tx=0x7f911c009040 comp rx=0 tx=0).stop 2023-08-09T14:16:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 msgr2=0x7f91240c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9118001eb0 tx=0x7f911800c8b0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 shutdown_connections 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f911006a0e0 0x7f911006c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f912415d720 0x7f91240c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f91240d1c20 0x7f91241f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 --2- 172.21.15.5:0/926119777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912415d340 0x7f91240c8f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 >> 172.21.15.5:0/926119777 conn(0x7f91240d2f30 msgr2=0x7f91240d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 shutdown_connections 2023-08-09T14:16:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.756+0000 7f912c423700 1 -- 172.21.15.5:0/926119777 wait complete. 2023-08-09T14:16:24.771 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T14:16:24.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T14:16:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.897+0000 7efdc7833700 1 Processor -- start 2023-08-09T14:16:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.897+0000 7efdc7833700 1 -- start start 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc7833700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdc006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc7833700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc006df50 con 0x7efdc015d510 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc7833700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc0161090 con 0x7efdc015d130 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc7833700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc006ab80 con 0x7efdc006a1c0 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc5dd0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efdc015d510 0x7efdc015d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57980/0 (socket says 172.21.15.5:57980) 2023-08-09T14:16:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc5dd0700 1 -- 172.21.15.5:0/2361524494 learned_addr learned my addr 172.21.15.5:0/2361524494 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.898+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdc006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433802912 0 0) 0x7efdc006df50 con 0x7efdc015d510 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdac0035b0 con 0x7efdc015d510 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648393425 0 0) 0x7efdc0161090 con 0x7efdc015d130 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc006df50 con 0x7efdc015d130 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718945975 0 0) 0x7efdac0035b0 con 0x7efdc015d510 2023-08-09T14:16:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 msgr2=0x7efdc006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdc006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 >> v1:172.21.15.101:6789/0 conn(0x7efdc015d130 legacy=0x7efdc006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0161370 con 0x7efdc015d510 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7efdb80019f0 con 0x7efdc015d510 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdc006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 >> v1:172.21.15.5:6789/0 conn(0x7efdc015d510 legacy=0x7efdc015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdac003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdac004d90 0x7efdac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc006ab80 con 0x7efdac004170 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac00bb50 con 0x7efdac004d90 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac00bd10 con 0x7efdc006a1c0 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc55cf700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdac003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc5dd0700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdac004d90 0x7efdac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 -- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 msgr2=0x7efdac003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc006a1c0 0x7efdac003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 -- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdac004d90 msgr2=0x7efdac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdac004d90 0x7efdac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.899+0000 7efdc4dce700 1 -- 172.21.15.5:0/2361524494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00094a0 con 0x7efdac004170 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdac004850 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d10 tx=0x7efdac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4191fd6428deb4c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0009da0 con 0x7efdac004170 2023-08-09T14:16:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb000e9a0 con 0x7efdac004170 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdb7fff700 1 -- 172.21.15.5:0/2361524494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000ed50 con 0x7efdac004170 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc7833700 1 -- 172.21.15.5:0/2361524494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 msgr2=0x7efdac004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc7833700 1 --2- 172.21.15.5:0/2361524494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdac004850 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d10 tx=0x7efdac005880 comp rx=0 tx=0).stop 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc5dd0700 1 -- 172.21.15.5:0/2361524494 reap_dead start 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc7833700 1 -- 172.21.15.5:0/2361524494 shutdown_connections 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc7833700 1 -- 172.21.15.5:0/2361524494 >> 172.21.15.5:0/2361524494 conn(0x7efdc00b1a20 msgr2=0x7efdc00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.900+0000 7efdc7833700 1 -- 172.21.15.5:0/2361524494 shutdown_connections 2023-08-09T14:16:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.901+0000 7efdc7833700 1 -- 172.21.15.5:0/2361524494 wait complete. 2023-08-09T14:16:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 Processor -- start 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 -- start start 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc00c79a0 0x7efdc00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdc015adb0 0x7efdc015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00c8360 con 0x7efdac004170 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc01f68e0 con 0x7efdc015adb0 2023-08-09T14:16:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.902+0000 7efdc7833700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc01f5cd0 con 0x7efdc00c79a0 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44574/0 (socket says 172.21.15.5:44574) 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 -- 172.21.15.5:0/2395497038 learned_addr learned my addr 172.21.15.5:0/2395497038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc5dd0700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdc015adb0 0x7efdc015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc00c79a0 0x7efdc00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 -- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc00c79a0 msgr2=0x7efdc00c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc00c79a0 0x7efdc00c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 -- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdc015adb0 msgr2=0x7efdc015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdc015adb0 0x7efdc015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 -- 172.21.15.5:0/2395497038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc01f5fb0 con 0x7efdac004170 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc55cf700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00f840 tx=0x7efdbc00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0052e0 con 0x7efdac004170 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc005480 con 0x7efdac004170 2023-08-09T14:16:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc01f6290 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0038c0 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.903+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc015b770 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.904+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc0074600 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.905+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efdbc003a20 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.905+0000 7efdb5ffb700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 0x7efda406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.905+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efdbc088150 con 0x7efdac004170 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.905+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 0x7efda406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.906+0000 7efdc4dce700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 0x7efda406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdb00090b0 tx=0x7efdb0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:24.909+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efdbc053ba0 con 0x7efdac004170 2023-08-09T14:16:25.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.106+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efdc0159b20 con 0x7efdac004170 2023-08-09T14:16:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.347+0000 7efdb5ffb700 1 -- 172.21.15.5:0/2395497038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7efdbc0571c0 con 0x7efdac004170 2023-08-09T14:16:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.350+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 msgr2=0x7efda406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.350+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 0x7efda406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdb00090b0 tx=0x7efdb0008030 comp rx=0 tx=0).stop 2023-08-09T14:16:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.350+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 msgr2=0x7efdc00c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.350+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00f840 tx=0x7efdbc00fc00 comp rx=0 tx=0).stop 2023-08-09T14:16:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 shutdown_connections 2023-08-09T14:16:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7efda406a0e0 0x7efda406c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7efdc015adb0 0x7efdc015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdac004170 0x7efdc00c5fc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 --2- 172.21.15.5:0/2395497038 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7efdc00c79a0 0x7efdc00c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.351+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 >> 172.21.15.5:0/2395497038 conn(0x7efdc00b1a20 msgr2=0x7efdc006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.352+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 shutdown_connections 2023-08-09T14:16:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.352+0000 7efdc7833700 1 -- 172.21.15.5:0/2395497038 wait complete. 2023-08-09T14:16:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-08-09T14:16:25.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T14:16:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.499+0000 7fab9658e700 1 Processor -- start 2023-08-09T14:16:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.499+0000 7fab9658e700 1 -- start start 2023-08-09T14:16:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab9658e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab900d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab9658e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900b40b0 con 0x7fab900cfd50 2023-08-09T14:16:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab9658e700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900cf180 con 0x7fab90160c90 2023-08-09T14:16:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab9658e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900ce7a0 con 0x7fab900d0130 2023-08-09T14:16:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab8ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fab900cfd50 0x7fab90160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57996/0 (socket says 172.21.15.5:57996) 2023-08-09T14:16:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.500+0000 7fab8ffff700 1 -- 172.21.15.5:0/4020826881 learned_addr learned my addr 172.21.15.5:0/4020826881 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab94b2b700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab900d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384538260 0 0) 0x7fab900b40b0 con 0x7fab900cfd50 2023-08-09T14:16:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab7c0035b0 con 0x7fab900cfd50 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1115359322 0 0) 0x7fab7c0035b0 con 0x7fab900cfd50 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 msgr2=0x7fab900d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab900d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 >> v1:172.21.15.101:6789/0 conn(0x7fab90160c90 legacy=0x7fab900d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900b4300 con 0x7fab900cfd50 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7fab80001670 con 0x7fab900cfd50 2023-08-09T14:16:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 >> v1:172.21.15.5:6789/0 conn(0x7fab900cfd50 legacy=0x7fab90160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab7c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c003fb0 0x7fab7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c004d90 0x7fab7c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900ce7a0 con 0x7fab7c004d90 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c00bba0 con 0x7fab7c003fb0 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c00bd60 con 0x7fab900d0130 2023-08-09T14:16:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab94b2b700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c004d90 0x7fab7c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8ffff700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab7c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.501+0000 7fab8f7fe700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c003fb0 0x7fab7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 -- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 msgr2=0x7fab7c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900d0130 0x7fab7c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 -- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c003fb0 msgr2=0x7fab7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c003fb0 0x7fab7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 -- 172.21.15.5:0/4020826881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0035b0 con 0x7fab7c004d90 2023-08-09T14:16:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c004d90 0x7fab7c005210 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab88009fc0 tx=0x7fab7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d63a921fe5ba9a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800ec30 con 0x7fab7c004d90 2023-08-09T14:16:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800f040 con 0x7fab7c004d90 2023-08-09T14:16:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab8effd700 1 -- 172.21.15.5:0/4020826881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88014480 con 0x7fab7c004d90 2023-08-09T14:16:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab9658e700 1 -- 172.21.15.5:0/4020826881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c004d90 msgr2=0x7fab7c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab9658e700 1 --2- 172.21.15.5:0/4020826881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c004d90 0x7fab7c005210 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab88009fc0 tx=0x7fab7c005880 comp rx=0 tx=0).stop 2023-08-09T14:16:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab94b2b700 1 -- 172.21.15.5:0/4020826881 reap_dead start 2023-08-09T14:16:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab9658e700 1 -- 172.21.15.5:0/4020826881 shutdown_connections 2023-08-09T14:16:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.502+0000 7fab9658e700 1 -- 172.21.15.5:0/4020826881 >> 172.21.15.5:0/4020826881 conn(0x7fab900d30f0 msgr2=0x7fab900d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.503+0000 7fab9658e700 1 -- 172.21.15.5:0/4020826881 shutdown_connections 2023-08-09T14:16:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.503+0000 7fab9658e700 1 -- 172.21.15.5:0/4020826881 wait complete. 2023-08-09T14:16:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.504+0000 7fab9658e700 1 Processor -- start 2023-08-09T14:16:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.504+0000 7fab9658e700 1 -- start start 2023-08-09T14:16:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 0x7fab900b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 0x7fab900cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015c3f0 con 0x7fab9015ba30 2023-08-09T14:16:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900cd510 con 0x7fab7c004d90 2023-08-09T14:16:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900cd230 con 0x7fab900cc490 2023-08-09T14:16:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44594/0 (socket says 172.21.15.5:44594) 2023-08-09T14:16:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 -- 172.21.15.5:0/1233462410 learned_addr learned my addr 172.21.15.5:0/1233462410 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab94b2b700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 0x7fab900cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8ffff700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 0x7fab900b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 -- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 msgr2=0x7fab900cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 0x7fab900cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 -- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 msgr2=0x7fab900b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 0x7fab900b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 -- 172.21.15.5:0/1233462410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab901414e0 con 0x7fab9015ba30 2023-08-09T14:16:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab94b2b700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 0x7fab900cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8ffff700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 0x7fab900b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8f7fe700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab7800f7f0 tx=0x7fab7800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab780052e0 con 0x7fab9015ba30 2023-08-09T14:16:25.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78005440 con 0x7fab9015ba30 2023-08-09T14:16:25.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901417c0 con 0x7fab9015ba30 2023-08-09T14:16:25.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab780038c0 con 0x7fab9015ba30 2023-08-09T14:16:25.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.505+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab900cce50 con 0x7fab9015ba30 2023-08-09T14:16:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.507+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90141ce0 con 0x7fab9015ba30 2023-08-09T14:16:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.507+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab78003a20 con 0x7fab9015ba30 2023-08-09T14:16:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.507+0000 7fab8cff9700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 0x7fab7006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.507+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fab78088230 con 0x7fab9015ba30 2023-08-09T14:16:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.507+0000 7fab8ffff700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 0x7fab7006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.508+0000 7fab8ffff700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 0x7fab7006c5d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab80001050 tx=0x7fab80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.512+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fab90141ce0 con 0x7fab9015ba30 2023-08-09T14:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:25.711+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fab90141ce0 con 0x7fab9015ba30 2023-08-09T14:16:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.356+0000 7fab8cff9700 1 -- 172.21.15.5:0/1233462410 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fab90141ce0 con 0x7fab9015ba30 2023-08-09T14:16:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.362+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 msgr2=0x7fab7006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.362+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 0x7fab7006c5d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab80001050 tx=0x7fab80009040 comp rx=0 tx=0).stop 2023-08-09T14:16:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.362+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 msgr2=0x7fab9015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.362+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab7800f7f0 tx=0x7fab7800fbb0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 shutdown_connections 2023-08-09T14:16:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fab7006a110 0x7fab7006c5d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fab900cc490 0x7fab900cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fab7c004d90 0x7fab900b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 --2- 172.21.15.5:0/1233462410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab9015ba30 0x7fab9015beb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.364+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 >> 172.21.15.5:0/1233462410 conn(0x7fab900d30f0 msgr2=0x7fab9015e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:26.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.371+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 shutdown_connections 2023-08-09T14:16:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.372+0000 7fab9658e700 1 -- 172.21.15.5:0/1233462410 wait complete. 2023-08-09T14:16:26.376 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-08-09T14:16:26.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T14:16:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.523+0000 7fb22f57a700 1 Processor -- start 2023-08-09T14:16:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.523+0000 7fb22f57a700 1 -- start start 2023-08-09T14:16:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22f57a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 0x7fb22815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22f57a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280cf500 con 0x7fb2280cb4b0 2023-08-09T14:16:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22f57a700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280cb920 con 0x7fb2280b6170 2023-08-09T14:16:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22f57a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22815fc90 con 0x7fb2280b2ff0 2023-08-09T14:16:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22db17700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2280cb4b0 0x7fb228151a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58020/0 (socket says 172.21.15.5:58020) 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22db17700 1 -- 172.21.15.5:0/2567849540 learned_addr learned my addr 172.21.15.5:0/2567849540 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb22cb15700 1 --2- 172.21.15.5:0/2567849540 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 0x7fb22815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524033636 0 0) 0x7fb2280cf500 con 0x7fb2280cb4b0 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2140035b0 con 0x7fb2280cb4b0 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.524+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159581726 0 0) 0x7fb2280cb920 con 0x7fb2280b6170 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2280cf500 con 0x7fb2280b6170 2023-08-09T14:16:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22cb15700 1 -- 172.21.15.5:0/2567849540 >> v1:172.21.15.101:6789/0 conn(0x7fb2280b6170 legacy=0x7fb2280b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933048190 0 0) 0x7fb2140035b0 con 0x7fb2280cb4b0 2023-08-09T14:16:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22cb15700 1 -- 172.21.15.5:0/2567849540 >> v1:172.21.15.5:6789/0 conn(0x7fb2280cb4b0 legacy=0x7fb228151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22cb15700 1 -- 172.21.15.5:0/2567849540 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22815c670 con 0x7fb2280b2ff0 2023-08-09T14:16:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22cb15700 1 --2- 172.21.15.5:0/2567849540 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 0x7fb22815f640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb224009870 tx=0x7fb224009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775ecd49047574ca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200019f0 con 0x7fb2280b2ff0 2023-08-09T14:16:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224004030 con 0x7fb2280b2ff0 2023-08-09T14:16:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb21ffff700 1 -- 172.21.15.5:0/2567849540 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240043a0 con 0x7fb2280b2ff0 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22f57a700 1 -- 172.21.15.5:0/2567849540 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 msgr2=0x7fb22815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.525+0000 7fb22f57a700 1 --2- 172.21.15.5:0/2567849540 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 0x7fb22815f640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb224009870 tx=0x7fb224009b80 comp rx=0 tx=0).stop 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.526+0000 7fb22f57a700 1 -- 172.21.15.5:0/2567849540 shutdown_connections 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.526+0000 7fb22f57a700 1 --2- 172.21.15.5:0/2567849540 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280b2ff0 0x7fb22815f640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.526+0000 7fb22f57a700 1 -- 172.21.15.5:0/2567849540 >> 172.21.15.5:0/2567849540 conn(0x7fb22806dec0 msgr2=0x7fb22806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.526+0000 7fb22f57a700 1 -- 172.21.15.5:0/2567849540 shutdown_connections 2023-08-09T14:16:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.526+0000 7fb22f57a700 1 -- 172.21.15.5:0/2567849540 wait complete. 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.527+0000 7fb22f57a700 1 Processor -- start 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.527+0000 7fb22f57a700 1 -- start start 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2280b2ff0 0x7fb2280b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280cb4b0 0x7fb228147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280c9be0 con 0x7fb2280b6170 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b2820 con 0x7fb2280b2ff0 2023-08-09T14:16:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b1f80 con 0x7fb2280cb4b0 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44608/0 (socket says 172.21.15.5:44608) 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 -- 172.21.15.5:0/3273626154 learned_addr learned my addr 172.21.15.5:0/3273626154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22db17700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280cb4b0 0x7fb228147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22d316700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2280b2ff0 0x7fb2280b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 -- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280cb4b0 msgr2=0x7fb228147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280cb4b0 0x7fb228147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 -- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2280b2ff0 msgr2=0x7fb2280b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2280b2ff0 0x7fb2280b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 -- 172.21.15.5:0/3273626154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240094a0 con 0x7fb2280b6170 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22cb15700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097c0 tx=0x7fb224004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240045b0 con 0x7fb2280b6170 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22401f070 con 0x7fb2280b6170 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2280b2260 con 0x7fb2280b6170 2023-08-09T14:16:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.528+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224011870 con 0x7fb2280b6170 2023-08-09T14:16:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.529+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2280c7fa0 con 0x7fb2280b6170 2023-08-09T14:16:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.529+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280c9d70 con 0x7fb2280b6170 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.530+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2240119d0 con 0x7fb2280b6170 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.531+0000 7fb21dffb700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.531+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb224021070 con 0x7fb2280b6170 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.531+0000 7fb22d316700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.531+0000 7fb22d316700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb218007fd0 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.535+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb224055600 con 0x7fb2280b6170 2023-08-09T14:16:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:26.780+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb2280cee80 con 0x7fb2280b6170 2023-08-09T14:16:27.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.360+0000 7fb21dffb700 1 -- 172.21.15.5:0/3273626154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb22402fe80 con 0x7fb2280b6170 2023-08-09T14:16:27.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.365+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 msgr2=0x7fb20c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.365+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb218007fd0 tx=0x7fb218009040 comp rx=0 tx=0).stop 2023-08-09T14:16:27.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.365+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 msgr2=0x7fb22806b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.365+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097c0 tx=0x7fb224004750 comp rx=0 tx=0).stop 2023-08-09T14:16:27.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 shutdown_connections 2023-08-09T14:16:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb2280cb4b0 0x7fb228147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb2280b2ff0 0x7fb2280b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 --2- 172.21.15.5:0/3273626154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2280b6170 0x7fb22806b2d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 >> 172.21.15.5:0/3273626154 conn(0x7fb22806dec0 msgr2=0x7fb228155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 shutdown_connections 2023-08-09T14:16:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.366+0000 7fb22f57a700 1 -- 172.21.15.5:0/3273626154 wait complete. 2023-08-09T14:16:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 5 and data pool 6 2023-08-09T14:16:27.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.526+0000 7fd6cee1e700 1 Processor -- start 2023-08-09T14:16:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.526+0000 7fd6cee1e700 1 -- start start 2023-08-09T14:16:27.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c8154600 0x7fd6c815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c815b360 0x7fd6c815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fd6c80ce410 0x7fd6c80ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80cede0 con 0x7fd6c815b360 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c815eb20 con 0x7fd6c80ce410 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cee1e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c806d4f0 con 0x7fd6c8154600 2023-08-09T14:16:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c815b360 0x7fd6c815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c815b360 0x7fd6c815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44630/0 (socket says 172.21.15.5:44630) 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 -- 172.21.15.5:0/616255940 learned_addr learned my addr 172.21.15.5:0/616255940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6cd3bb700 1 --2- 172.21.15.5:0/616255940 >> v2:172.21.15.101:3300/0 conn(0x7fd6c80ce410 0x7fd6c80ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6ccbba700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c8154600 0x7fd6c815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 -- 172.21.15.5:0/616255940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c8154600 msgr2=0x7fd6c815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c8154600 0x7fd6c815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 -- 172.21.15.5:0/616255940 >> v2:172.21.15.101:3300/0 conn(0x7fd6c80ce410 msgr2=0x7fd6c80ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 --2- 172.21.15.5:0/616255940 >> v2:172.21.15.101:3300/0 conn(0x7fd6c80ce410 0x7fd6c80ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 -- 172.21.15.5:0/616255940 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c815e560 con 0x7fd6c815b360 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c7fff700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c815dbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80c3480 tx=0x7fd6b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef3dd3cdcb5e4b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c77fe700 1 -- 172.21.15.5:0/616255940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400b870 con 0x7fd6c815b360 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c77fe700 1 -- 172.21.15.5:0/616255940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b400b9d0 con 0x7fd6c815b360 2023-08-09T14:16:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.527+0000 7fd6c77fe700 1 -- 172.21.15.5:0/616255940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400bd60 con 0x7fd6c815b360 2023-08-09T14:16:27.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 -- 172.21.15.5:0/616255940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 msgr2=0x7fd6c815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c815dbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80c3480 tx=0x7fd6b4009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 -- 172.21.15.5:0/616255940 shutdown_connections 2023-08-09T14:16:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/616255940 >> v2:172.21.15.101:3300/0 conn(0x7fd6c80ce410 0x7fd6c80ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c8154600 0x7fd6c815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/616255940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c815dbc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 -- 172.21.15.5:0/616255940 >> 172.21.15.5:0/616255940 conn(0x7fd6c80b1900 msgr2=0x7fd6c80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 -- 172.21.15.5:0/616255940 shutdown_connections 2023-08-09T14:16:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.528+0000 7fd6cee1e700 1 -- 172.21.15.5:0/616255940 wait complete. 2023-08-09T14:16:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.529+0000 7fd6cee1e700 1 Processor -- start 2023-08-09T14:16:27.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.529+0000 7fd6cee1e700 1 -- start start 2023-08-09T14:16:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c80ce410 0x7fd6c815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd6c8154600 0x7fd6c815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80b3a60 con 0x7fd6c815b360 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80b3d00 con 0x7fd6c8154600 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cee1e700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80b3fe0 con 0x7fd6c80ce410 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cd3bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cd3bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44640/0 (socket says 172.21.15.5:44640) 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6c7fff700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd6c8154600 0x7fd6c815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6ccbba700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c80ce410 0x7fd6c815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.530+0000 7fd6cd3bb700 1 -- 172.21.15.5:0/3788640551 learned_addr learned my addr 172.21.15.5:0/3788640551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:27.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 -- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c80ce410 msgr2=0x7fd6c815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c80ce410 0x7fd6c815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 -- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd6c8154600 msgr2=0x7fd6c815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd6c8154600 0x7fd6c815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 -- 172.21.15.5:0/3788640551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009550 con 0x7fd6c815b360 2023-08-09T14:16:27.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cd3bb700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000ccf0 tx=0x7fd6c000a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000ad60 con 0x7fd6c815b360 2023-08-09T14:16:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0003a20 con 0x7fd6c815b360 2023-08-09T14:16:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c80b42c0 con 0x7fd6c815b360 2023-08-09T14:16:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0003db0 con 0x7fd6c815b360 2023-08-09T14:16:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.531+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c80b4880 con 0x7fd6c815b360 2023-08-09T14:16:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.532+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c8074600 con 0x7fd6c815b360 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.532+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd6c0003f50 con 0x7fd6c815b360 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.533+0000 7fd6c57fa700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 0x7fd6ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.533+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6c0012070 con 0x7fd6c815b360 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.533+0000 7fd6ccbba700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 0x7fd6ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.534+0000 7fd6ccbba700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 0x7fd6ac06c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00ab60 tx=0x7fd6bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.537+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd6c0054290 con 0x7fd6c815b360 2023-08-09T14:16:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.739+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6c80c9f90 con 0x7fd6c815b360 2023-08-09T14:16:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.740+0000 7fd6c57fa700 1 -- 172.21.15.5:0/3788640551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fd6c00578b0 con 0x7fd6c815b360 2023-08-09T14:16:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:27.743 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:26.782180+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:16:25.137999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T14:16:25.743028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 msgr2=0x7fd6ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 0x7fd6ac06c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00ab60 tx=0x7fd6bc008040 comp rx=0 tx=0).stop 2023-08-09T14:16:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 msgr2=0x7fd6c814de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000ccf0 tx=0x7fd6c000a290 comp rx=0 tx=0).stop 2023-08-09T14:16:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 shutdown_connections 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fd6ac06a0e0 0x7fd6ac06c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c815b360 0x7fd6c814de30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fd6c80ce410 0x7fd6c815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 --2- 172.21.15.5:0/3788640551 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fd6c8154600 0x7fd6c815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 >> 172.21.15.5:0/3788640551 conn(0x7fd6c80b1900 msgr2=0x7fd6c80cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 shutdown_connections 2023-08-09T14:16:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.742+0000 7fd6cee1e700 1 -- 172.21.15.5:0/3788640551 wait complete. 2023-08-09T14:16:27.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.879+0000 7f1f2afc9700 1 Processor -- start 2023-08-09T14:16:27.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.879+0000 7f1f2afc9700 1 -- start start 2023-08-09T14:16:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f2afc9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 0x7f1f240ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f2afc9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f240cee00 con 0x7f1f2415b360 2023-08-09T14:16:27.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f2afc9700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2415eb20 con 0x7f1f24154600 2023-08-09T14:16:27.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f2afc9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2415e2d0 con 0x7f1f240ce410 2023-08-09T14:16:27.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f23fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f2415b360 0x7f1f2415dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58060/0 (socket says 172.21.15.5:58060) 2023-08-09T14:16:27.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f23fff700 1 -- 172.21.15.5:0/1163487862 learned_addr learned my addr 172.21.15.5:0/1163487862 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.880+0000 7f1f29566700 1 --2- 172.21.15.5:0/1163487862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 0x7f1f240ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090704827 0 0) 0x7f1f10001110 con 0x7f1f2415b360 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f140035b0 con 0x7f1f2415b360 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596599931 0 0) 0x7f1f2415eb20 con 0x7f1f24154600 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f10001110 con 0x7f1f24154600 2023-08-09T14:16:27.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940962826 0 0) 0x7f1f140035b0 con 0x7f1f2415b360 2023-08-09T14:16:27.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f29566700 1 -- 172.21.15.5:0/1163487862 >> v1:172.21.15.101:6789/0 conn(0x7f1f24154600 legacy=0x7f1f2415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f29566700 1 -- 172.21.15.5:0/1163487862 >> v1:172.21.15.5:6789/0 conn(0x7f1f2415b360 legacy=0x7f1f2415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f29566700 1 -- 172.21.15.5:0/1163487862 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2406d4f0 con 0x7f1f240ce410 2023-08-09T14:16:27.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f29566700 1 --2- 172.21.15.5:0/1163487862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 0x7f1f240ce8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009dc0 tx=0x7f1f1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3de88a83e5dd2b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00e070 con 0x7f1f240ce410 2023-08-09T14:16:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c003a20 con 0x7f1f240ce410 2023-08-09T14:16:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.881+0000 7f1f237fe700 1 -- 172.21.15.5:0/1163487862 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10001800 con 0x7f1f240ce410 2023-08-09T14:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 -- 172.21.15.5:0/1163487862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 msgr2=0x7f1f240ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/1163487862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 0x7f1f240ce8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009dc0 tx=0x7f1f1c00b330 comp rx=0 tx=0).stop 2023-08-09T14:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 -- 172.21.15.5:0/1163487862 shutdown_connections 2023-08-09T14:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/1163487862 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f240ce410 0x7f1f240ce8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 -- 172.21.15.5:0/1163487862 >> 172.21.15.5:0/1163487862 conn(0x7f1f240b1900 msgr2=0x7f1f240b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 -- 172.21.15.5:0/1163487862 shutdown_connections 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.882+0000 7f1f2afc9700 1 -- 172.21.15.5:0/1163487862 wait complete. 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.883+0000 7f1f2afc9700 1 Processor -- start 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.884+0000 7f1f2afc9700 1 -- start start 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1f240ce410 0x7f1f240cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f24154600 0x7f1f241ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f240c7c30 con 0x7f1f2415b360 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f240cb240 con 0x7f1f240ce410 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f240cb520 con 0x7f1f24154600 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44652/0 (socket says 172.21.15.5:44652) 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 -- 172.21.15.5:0/173763718 learned_addr learned my addr 172.21.15.5:0/173763718 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f23fff700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f24154600 0x7f1f241ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f28d65700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1f240ce410 0x7f1f240cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 -- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f24154600 msgr2=0x7f1f241ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f24154600 0x7f1f241ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 -- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1f240ce410 msgr2=0x7f1f240cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1f240ce410 0x7f1f240cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 -- 172.21.15.5:0/173763718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c009a70 con 0x7f1f2415b360 2023-08-09T14:16:27.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f29566700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009d90 tx=0x7f1f1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0044c0 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c004620 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f240cb800 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.885+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c01d570 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.886+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f241f0920 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.887+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f240cbd20 con 0x7f1f2415b360 2023-08-09T14:16:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.887+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f1c023070 con 0x7f1f2415b360 2023-08-09T14:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.887+0000 7f1f217fa700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 0x7f1f0806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.887+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f1c08b6b0 con 0x7f1f2415b360 2023-08-09T14:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.887+0000 7f1f28d65700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 0x7f1f0806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.888+0000 7f1f28d65700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 0x7f1f0806c5d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f18001220 tx=0x7f1f18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:27.892+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1f240cbd20 con 0x7f1f2415b360 2023-08-09T14:16:28.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.093+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f240cbd20 con 0x7f1f2415b360 2023-08-09T14:16:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.095+0000 7f1f217fa700 1 -- 172.21.15.5:0/173763718 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18258 (secure 0 0 0) 0x7f1f240cbd20 con 0x7f1f2415b360 2023-08-09T14:16:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:28.097 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:26.782180+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:16:25.137999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T14:16:25.743028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 msgr2=0x7f1f0806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 0x7f1f0806c5d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f18001220 tx=0x7f1f18009040 comp rx=0 tx=0).stop 2023-08-09T14:16:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 msgr2=0x7f1f241f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009d90 tx=0x7f1f1c004ad0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 shutdown_connections 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1f0806a110 0x7f1f0806c5d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2415b360 0x7f1f241f03e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1f240ce410 0x7f1f240cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 --2- 172.21.15.5:0/173763718 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1f24154600 0x7f1f241ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 >> 172.21.15.5:0/173763718 conn(0x7f1f240b1900 msgr2=0x7f1f2415b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 shutdown_connections 2023-08-09T14:16:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.097+0000 7f1f2afc9700 1 -- 172.21.15.5:0/173763718 wait complete. 2023-08-09T14:16:28.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T14:16:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.237+0000 7f26e77d9700 1 Processor -- start 2023-08-09T14:16:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.238+0000 7f26e77d9700 1 -- start start 2023-08-09T14:16:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.238+0000 7f26e77d9700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f26e00b0420 0x7f26e006c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.238+0000 7f26e77d9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e006bce0 con 0x7f26e00ccd40 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.238+0000 7f26e77d9700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e006ccf0 con 0x7f26e00cc960 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.238+0000 7f26e77d9700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e006cb50 con 0x7f26e00b0420 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e4d74700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26e00ccd40 0x7f26e00d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58074/0 (socket says 172.21.15.5:58074) 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e4d74700 1 -- 172.21.15.5:0/4074744173 learned_addr learned my addr 172.21.15.5:0/4074744173 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e5d76700 1 --2- 172.21.15.5:0/4074744173 >> v2:172.21.15.101:3300/0 conn(0x7f26e00b0420 0x7f26e006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545600505 0 0) 0x7f26e006bce0 con 0x7f26e00ccd40 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26cc0035b0 con 0x7f26e00ccd40 2023-08-09T14:16:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913641761 0 0) 0x7f26cc0035b0 con 0x7f26e00ccd40 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 >> v2:172.21.15.101:3300/0 conn(0x7f26e00b0420 msgr2=0x7f26e006c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 --2- 172.21.15.5:0/4074744173 >> v2:172.21.15.101:3300/0 conn(0x7f26e00b0420 0x7f26e006c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 >> v1:172.21.15.101:6789/0 conn(0x7f26e00cc960 legacy=0x7f26e0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e006c210 con 0x7f26e00ccd40 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f26d4001670 con 0x7f26e00ccd40 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 >> v1:172.21.15.5:6789/0 conn(0x7f26e00ccd40 legacy=0x7f26e00d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26cc005210 0x7f26cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc00c180 con 0x7f26cc004850 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc00c2f0 con 0x7f26cc005210 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc00c4b0 con 0x7f26cc003a00 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e4d74700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e5d76700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26cc005210 0x7f26cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.239+0000 7f26e5575700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 -- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26cc003a00 msgr2=0x7f26cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 -- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26cc005210 msgr2=0x7f26cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26cc005210 0x7f26cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 -- 172.21.15.5:0/4074744173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0035b0 con 0x7f26cc004850 2023-08-09T14:16:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e5d76700 1 -- 172.21.15.5:0/4074744173 reap_dead start 2023-08-09T14:16:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e5575700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e4d74700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26cc004cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c240 tx=0x7f26cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310d6b828be590d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4007c10 con 0x7f26cc004850 2023-08-09T14:16:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400cd60 con 0x7f26cc004850 2023-08-09T14:16:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26d3fff700 1 -- 172.21.15.5:0/4074744173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4005ba0 con 0x7f26cc004850 2023-08-09T14:16:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e77d9700 1 -- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 msgr2=0x7f26cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.240+0000 7f26e77d9700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26cc004cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c240 tx=0x7f26cc005880 comp rx=0 tx=0).stop 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.241+0000 7f26e77d9700 1 -- 172.21.15.5:0/4074744173 shutdown_connections 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.241+0000 7f26e77d9700 1 --2- 172.21.15.5:0/4074744173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26cc004cd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.241+0000 7f26e77d9700 1 -- 172.21.15.5:0/4074744173 >> 172.21.15.5:0/4074744173 conn(0x7f26e006dec0 msgr2=0x7f26e006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.241+0000 7f26e77d9700 1 -- 172.21.15.5:0/4074744173 shutdown_connections 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.241+0000 7f26e77d9700 1 -- 172.21.15.5:0/4074744173 wait complete. 2023-08-09T14:16:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.242+0000 7f26e77d9700 1 Processor -- start 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.242+0000 7f26e77d9700 1 -- start start 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26e01d7340 0x7f26e00c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26e01d77c0 0x7f26e01d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01d62a0 con 0x7f26cc004850 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01d6580 con 0x7f26e01d77c0 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01d6860 con 0x7f26e01d7340 2023-08-09T14:16:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44668/0 (socket says 172.21.15.5:44668) 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 -- 172.21.15.5:0/838250207 learned_addr learned my addr 172.21.15.5:0/838250207 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5d76700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26e01d77c0 0x7f26e01d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e4d74700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26e01d7340 0x7f26e00c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 -- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26e01d7340 msgr2=0x7f26e00c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26e01d7340 0x7f26e00c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 -- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26e01d77c0 msgr2=0x7f26e01d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26e01d77c0 0x7f26e01d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 -- 172.21.15.5:0/838250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e01d6b40 con 0x7f26cc004850 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e5575700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00e460 tx=0x7f26dc00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0052e0 con 0x7f26cc004850 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc005440 con 0x7f26cc004850 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e01d6e20 con 0x7f26cc004850 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.243+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0038c0 con 0x7f26cc004850 2023-08-09T14:16:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.244+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00c5300 con 0x7f26cc004850 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.244+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0074600 con 0x7f26cc004850 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.245+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26dc003a20 con 0x7f26cc004850 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.245+0000 7f26d1ffb700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 0x7f26c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.245+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26dc087a20 con 0x7f26cc004850 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.246+0000 7f26e4d74700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 0x7f26c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.246+0000 7f26e4d74700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 0x7f26c406c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26e00ad560 tx=0x7f26d4007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.250+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f26dc0531c0 con 0x7f26cc004850 2023-08-09T14:16:28.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:28.503+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f26e00c5300 con 0x7f26cc004850 2023-08-09T14:16:29.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.376+0000 7f26d1ffb700 1 -- 172.21.15.5:0/838250207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f26e00c5300 con 0x7f26cc004850 2023-08-09T14:16:29.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 msgr2=0x7f26c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 0x7f26c406c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26e00ad560 tx=0x7f26d4007000 comp rx=0 tx=0).stop 2023-08-09T14:16:29.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 msgr2=0x7f26e00c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00e460 tx=0x7f26dc00e820 comp rx=0 tx=0).stop 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 shutdown_connections 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f26c406a0e0 0x7f26c406c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f26e01d77c0 0x7f26e01d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26cc004850 0x7f26e00c7880 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 --2- 172.21.15.5:0/838250207 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f26e01d7340 0x7f26e00c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 >> 172.21.15.5:0/838250207 conn(0x7f26e006dec0 msgr2=0x7f26e01e41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 shutdown_connections 2023-08-09T14:16:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.380+0000 7f26e77d9700 1 -- 172.21.15.5:0/838250207 wait complete. 2023-08-09T14:16:29.398 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T14:16:29.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T14:16:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.531+0000 7f5e363e9700 1 Processor -- start 2023-08-09T14:16:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e363e9700 1 -- start start 2023-08-09T14:16:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e363e9700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f5e300b2c70 0x7f5e300cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e363e9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300cb2d0 con 0x7f5e300ce410 2023-08-09T14:16:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e363e9700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300cb5b0 con 0x7f5e30159e90 2023-08-09T14:16:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e363e9700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300cb890 con 0x7f5e300b2c70 2023-08-09T14:16:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.532+0000 7f5e34986700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e300ce410 0x7f5e300cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58096/0 (socket says 172.21.15.5:58096) 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e34986700 1 -- 172.21.15.5:0/726911015 learned_addr learned my addr 172.21.15.5:0/726911015 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2f7fe700 1 --2- 172.21.15.5:0/726911015 >> v2:172.21.15.101:3300/0 conn(0x7f5e300b2c70 0x7f5e300cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095256544 0 0) 0x7f5e300cb2d0 con 0x7f5e300ce410 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e180035b0 con 0x7f5e300ce410 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393910147 0 0) 0x7f5e300cb5b0 con 0x7f5e30159e90 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e300cb2d0 con 0x7f5e30159e90 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1261061206 0 0) 0x7f5e180035b0 con 0x7f5e300ce410 2023-08-09T14:16:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 >> v2:172.21.15.101:3300/0 conn(0x7f5e300b2c70 msgr2=0x7f5e300cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 --2- 172.21.15.5:0/726911015 >> v2:172.21.15.101:3300/0 conn(0x7f5e300b2c70 0x7f5e300cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 >> v1:172.21.15.101:6789/0 conn(0x7f5e30159e90 legacy=0x7f5e3006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300cbb70 con 0x7f5e300ce410 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f5e280019f0 con 0x7f5e300ce410 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 >> v1:172.21.15.5:6789/0 conn(0x7f5e300ce410 legacy=0x7f5e300cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e18003b90 0x7f5e18003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18004850 0x7f5e18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 0x7f5e1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300cb890 con 0x7f5e18005210 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1800c090 con 0x7f5e18003b90 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1800c250 con 0x7f5e18004850 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2f7fe700 1 --2- 172.21.15.5:0/726911015 >> v2:172.21.15.101:3300/0 conn(0x7f5e300b2c70 0x7f5e300cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e34986700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 0x7f5e1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2ffff700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e18003b90 0x7f5e18003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.533+0000 7f5e2f7fe700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18004850 0x7f5e18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 -- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18004850 msgr2=0x7f5e18004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18004850 0x7f5e18004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 -- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e18003b90 msgr2=0x7f5e18003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e18003b90 0x7f5e18003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 -- 172.21.15.5:0/726911015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180035b0 con 0x7f5e18005210 2023-08-09T14:16:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 -- 172.21.15.5:0/726911015 reap_dead start 2023-08-09T14:16:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e34986700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 0x7f5e1800ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800a7a0 tx=0x7f5e18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baddc0017d74eb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28012600 con 0x7f5e18005210 2023-08-09T14:16:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28012780 con 0x7f5e18005210 2023-08-09T14:16:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e2effd700 1 -- 172.21.15.5:0/726911015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28012b30 con 0x7f5e18005210 2023-08-09T14:16:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e363e9700 1 -- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 msgr2=0x7f5e1800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e363e9700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 0x7f5e1800ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800a7a0 tx=0x7f5e18005880 comp rx=0 tx=0).stop 2023-08-09T14:16:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e363e9700 1 -- 172.21.15.5:0/726911015 shutdown_connections 2023-08-09T14:16:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e363e9700 1 --2- 172.21.15.5:0/726911015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e18005210 0x7f5e1800ba10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.534+0000 7f5e363e9700 1 -- 172.21.15.5:0/726911015 >> 172.21.15.5:0/726911015 conn(0x7f5e300b1970 msgr2=0x7f5e300b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.535+0000 7f5e363e9700 1 -- 172.21.15.5:0/726911015 shutdown_connections 2023-08-09T14:16:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.535+0000 7f5e363e9700 1 -- 172.21.15.5:0/726911015 wait complete. 2023-08-09T14:16:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.536+0000 7f5e363e9700 1 Processor -- start 2023-08-09T14:16:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.536+0000 7f5e363e9700 1 -- start start 2023-08-09T14:16:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18005210 0x7f5e30150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 0x7f5e300c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30150aa0 con 0x7f5e300c99f0 2023-08-09T14:16:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300ca000 con 0x7f5e30155bf0 2023-08-09T14:16:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300c6fe0 con 0x7f5e18005210 2023-08-09T14:16:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44692/0 (socket says 172.21.15.5:44692) 2023-08-09T14:16:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 -- 172.21.15.5:0/2544731592 learned_addr learned my addr 172.21.15.5:0/2544731592 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2f7fe700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 0x7f5e300c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2ffff700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18005210 0x7f5e30150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 -- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18005210 msgr2=0x7f5e30150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18005210 0x7f5e30150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 -- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 msgr2=0x7f5e300c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 0x7f5e300c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 -- 172.21.15.5:0/2544731592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300c72c0 con 0x7f5e300c99f0 2023-08-09T14:16:29.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2f7fe700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 0x7f5e300c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:29.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e34986700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ca560 tx=0x7f5e28001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:29.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28020070 con 0x7f5e300c99f0 2023-08-09T14:16:29.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e280019c0 con 0x7f5e300c99f0 2023-08-09T14:16:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300c75a0 con 0x7f5e300c99f0 2023-08-09T14:16:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.537+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28025620 con 0x7f5e300c99f0 2023-08-09T14:16:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.538+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e301f3760 con 0x7f5e300c99f0 2023-08-09T14:16:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.538+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e300c7ac0 con 0x7f5e300c99f0 2023-08-09T14:16:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.539+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e28019420 con 0x7f5e300c99f0 2023-08-09T14:16:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.539+0000 7f5e2cff9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 0x7f5e1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.539+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e2808a7c0 con 0x7f5e300c99f0 2023-08-09T14:16:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.539+0000 7f5e2ffff700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 0x7f5e1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:29.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.540+0000 7f5e2ffff700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 0x7f5e1c06c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000c00 tx=0x7f5e24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:29.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.544+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5e300c7ac0 con 0x7f5e300c99f0 2023-08-09T14:16:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:29.787+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e300c7ac0 con 0x7f5e300c99f0 2023-08-09T14:16:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.384+0000 7f5e2cff9700 1 -- 172.21.15.5:0/2544731592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e300c7ac0 con 0x7f5e300c99f0 2023-08-09T14:16:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 msgr2=0x7f5e1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 0x7f5e1c06c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000c00 tx=0x7f5e24009040 comp rx=0 tx=0).stop 2023-08-09T14:16:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 msgr2=0x7f5e30157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ca560 tx=0x7f5e28001d00 comp rx=0 tx=0).stop 2023-08-09T14:16:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 shutdown_connections 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5e1c06a0e0 0x7f5e1c06c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e300c99f0 0x7f5e30157a40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5e18005210 0x7f5e30150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 --2- 172.21.15.5:0/2544731592 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5e30155bf0 0x7f5e300c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 >> 172.21.15.5:0/2544731592 conn(0x7f5e300b1970 msgr2=0x7f5e300af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 shutdown_connections 2023-08-09T14:16:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.387+0000 7f5e363e9700 1 -- 172.21.15.5:0/2544731592 wait complete. 2023-08-09T14:16:30.405 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T14:16:30.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.536+0000 7f84f80b2700 1 Processor -- start 2023-08-09T14:16:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.536+0000 7f84f80b2700 1 -- start start 2023-08-09T14:16:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f80b2700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f84f015d400 0x7f84f00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f80b2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84f006a1c0 0x7f84f006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f80b2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f006e850 con 0x7f84f006cd50 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f80b2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f006ab80 con 0x7f84f006a1c0 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f80b2700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f00cf7b0 con 0x7f84f015d400 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f564d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84f006a1c0 0x7f84f006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f664f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84f006cd50 0x7f84f006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58114/0 (socket says 172.21.15.5:58114) 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f664f700 1 -- 172.21.15.5:0/3906691064 learned_addr learned my addr 172.21.15.5:0/3906691064 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.537+0000 7f84f5e4e700 1 --2- 172.21.15.5:0/3906691064 >> v2:172.21.15.101:3300/0 conn(0x7f84f015d400 0x7f84f00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f564d700 1 -- 172.21.15.5:0/3906691064 >> v2:172.21.15.101:3300/0 conn(0x7f84f015d400 msgr2=0x7f84f00cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f564d700 1 --2- 172.21.15.5:0/3906691064 >> v2:172.21.15.101:3300/0 conn(0x7f84f015d400 0x7f84f00cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f564d700 1 -- 172.21.15.5:0/3906691064 >> v1:172.21.15.5:6789/0 conn(0x7f84f006cd50 legacy=0x7f84f006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f564d700 1 -- 172.21.15.5:0/3906691064 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00cfa90 con 0x7f84f006a1c0 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f564d700 1 --2- 172.21.15.5:0/3906691064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006a1c0 0x7f84f006a640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84f0071260 tx=0x7f84ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec94dd1a102ffc53 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f4e4c700 1 -- 172.21.15.5:0/3906691064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011830 con 0x7f84f006a1c0 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f4e4c700 1 -- 172.21.15.5:0/3906691064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec011990 con 0x7f84f006a1c0 2023-08-09T14:16:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f4e4c700 1 -- 172.21.15.5:0/3906691064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011d20 con 0x7f84f006a1c0 2023-08-09T14:16:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f80b2700 1 -- 172.21.15.5:0/3906691064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006a1c0 msgr2=0x7f84f006a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f80b2700 1 --2- 172.21.15.5:0/3906691064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006a1c0 0x7f84f006a640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84f0071260 tx=0x7f84ec009b20 comp rx=0 tx=0).stop 2023-08-09T14:16:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.538+0000 7f84f80b2700 1 -- 172.21.15.5:0/3906691064 shutdown_connections 2023-08-09T14:16:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.539+0000 7f84f80b2700 1 --2- 172.21.15.5:0/3906691064 >> v2:172.21.15.101:3300/0 conn(0x7f84f015d400 0x7f84f00cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.539+0000 7f84f80b2700 1 --2- 172.21.15.5:0/3906691064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006a1c0 0x7f84f006a640 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.539+0000 7f84f80b2700 1 -- 172.21.15.5:0/3906691064 >> 172.21.15.5:0/3906691064 conn(0x7f84f00b1900 msgr2=0x7f84f00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.539+0000 7f84f80b2700 1 -- 172.21.15.5:0/3906691064 shutdown_connections 2023-08-09T14:16:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.539+0000 7f84f80b2700 1 -- 172.21.15.5:0/3906691064 wait complete. 2023-08-09T14:16:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.540+0000 7f84f80b2700 1 Processor -- start 2023-08-09T14:16:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.540+0000 7f84f80b2700 1 -- start start 2023-08-09T14:16:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f84f006a1c0 0x7f84f0157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 0x7f84f00b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0158530 con 0x7f84f006cd50 2023-08-09T14:16:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0160130 con 0x7f84f015d400 2023-08-09T14:16:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f80b2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0160410 con 0x7f84f006a1c0 2023-08-09T14:16:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f564d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f564d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44704/0 (socket says 172.21.15.5:44704) 2023-08-09T14:16:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f564d700 1 -- 172.21.15.5:0/1757755386 learned_addr learned my addr 172.21.15.5:0/1757755386 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f5e4e700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f84f006a1c0 0x7f84f0157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.541+0000 7f84f664f700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 0x7f84f00b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 -- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f84f006a1c0 msgr2=0x7f84f0157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f84f006a1c0 0x7f84f0157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 -- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 msgr2=0x7f84f00b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 0x7f84f00b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 -- 172.21.15.5:0/1757755386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0094a0 con 0x7f84f006cd50 2023-08-09T14:16:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f664f700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 0x7f84f00b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f564d700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84ec000c00 tx=0x7f84ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0038a0 con 0x7f84f006cd50 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec01f070 con 0x7f84f006cd50 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f01606f0 con 0x7f84f006cd50 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec003c20 con 0x7f84f006cd50 2023-08-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.542+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f0160cb0 con 0x7f84f006cd50 2023-08-09T14:16:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.543+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f0074600 con 0x7f84f006cd50 2023-08-09T14:16:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.543+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84ec01a430 con 0x7f84f006cd50 2023-08-09T14:16:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.544+0000 7f84e67fc700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 0x7f84d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.544+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84ec021070 con 0x7f84f006cd50 2023-08-09T14:16:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.544+0000 7f84f5e4e700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 0x7f84d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.545+0000 7f84f5e4e700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 0x7f84d406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b9b0 tx=0x7f84e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.548+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f84ec055780 con 0x7f84f006cd50 2023-08-09T14:16:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.790+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84f0071530 con 0x7f84f006cd50 2023-08-09T14:16:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.790+0000 7f84e67fc700 1 -- 172.21.15.5:0/1757755386 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f84ec058da0 con 0x7f84f006cd50 2023-08-09T14:16:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:30.793 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/4007626462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6835","nonce":4007626462},{"type":"v1","addr":"172.21.15.101:6837","nonce":4007626462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6836/1598020382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":1598020382},{"type":"v1","addr":"172.21.15.101:6836","nonce":1598020382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1624368883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1624368883},{"type":"v1","addr":"172.21.15.5:6835","nonce":1624368883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:16:26.782509+0000","modified":"2023-08-09T14:16:30.379487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5154},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5154":{"gid":5154,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/3709637189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3709637189},{"type":"v1","addr":"172.21.15.5:6833","nonce":3709637189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T14:16:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 msgr2=0x7f84d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 0x7f84d406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b9b0 tx=0x7f84e0008040 comp rx=0 tx=0).stop 2023-08-09T14:16:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 msgr2=0x7f84f015f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84ec000c00 tx=0x7f84ec004750 comp rx=0 tx=0).stop 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 shutdown_connections 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f84d406a0e0 0x7f84d406c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f84f015d400 0x7f84f00b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f84f006a1c0 0x7f84f0157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 --2- 172.21.15.5:0/1757755386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84f006cd50 0x7f84f015f850 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 >> 172.21.15.5:0/1757755386 conn(0x7f84f00b1900 msgr2=0x7f84f006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 shutdown_connections 2023-08-09T14:16:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.792+0000 7f84f80b2700 1 -- 172.21.15.5:0/1757755386 wait complete. 2023-08-09T14:16:30.797 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2023-08-09T14:16:30.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:16:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.930+0000 7feb0020b700 1 Processor -- start 2023-08-09T14:16:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.930+0000 7feb0020b700 1 -- start start 2023-08-09T14:16:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf815b320 0x7feaf8065f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80c6630 0x7feaf80c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 0x7feaf806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80ca560 con 0x7feaf815b320 2023-08-09T14:16:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80722b0 con 0x7feaf80ca0f0 2023-08-09T14:16:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feb0020b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8072520 con 0x7feaf80c6630 2023-08-09T14:16:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf815b320 0x7feaf8065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf815b320 0x7feaf8065f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44710/0 (socket says 172.21.15.5:44710) 2023-08-09T14:16:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 -- 172.21.15.5:0/1360202626 learned_addr learned my addr 172.21.15.5:0/1360202626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafe7a8700 1 --2- 172.21.15.5:0/1360202626 >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 0x7feaf806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafd7a6700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80c6630 0x7feaf80c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 -- 172.21.15.5:0/1360202626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80c6630 msgr2=0x7feaf80c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80c6630 0x7feaf80c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 -- 172.21.15.5:0/1360202626 >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 msgr2=0x7feaf806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1360202626 >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 0x7feaf806a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 -- 172.21.15.5:0/1360202626 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80705b0 con 0x7feaf815b320 2023-08-09T14:16:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafe7a8700 1 --2- 172.21.15.5:0/1360202626 >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 0x7feaf806a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.931+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815b320 0x7feaf8065f50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b0fe0 tx=0x7feae8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9d1c352adbf428 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feafcfa5700 1 -- 172.21.15.5:0/1360202626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800b870 con 0x7feaf815b320 2023-08-09T14:16:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feafcfa5700 1 -- 172.21.15.5:0/1360202626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800b9d0 con 0x7feaf815b320 2023-08-09T14:16:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feafcfa5700 1 -- 172.21.15.5:0/1360202626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800bd60 con 0x7feaf815b320 2023-08-09T14:16:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 -- 172.21.15.5:0/1360202626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815b320 msgr2=0x7feaf8065f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815b320 0x7feaf8065f50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b0fe0 tx=0x7feae8009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 -- 172.21.15.5:0/1360202626 shutdown_connections 2023-08-09T14:16:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 --2- 172.21.15.5:0/1360202626 >> v2:172.21.15.101:3300/0 conn(0x7feaf80ca0f0 0x7feaf806a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815b320 0x7feaf8065f50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 --2- 172.21.15.5:0/1360202626 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf80c6630 0x7feaf80c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 -- 172.21.15.5:0/1360202626 >> 172.21.15.5:0/1360202626 conn(0x7feaf80cf560 msgr2=0x7feaf80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 -- 172.21.15.5:0/1360202626 shutdown_connections 2023-08-09T14:16:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.932+0000 7feb0020b700 1 -- 172.21.15.5:0/1360202626 wait complete. 2023-08-09T14:16:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.933+0000 7feb0020b700 1 Processor -- start 2023-08-09T14:16:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 -- start start 2023-08-09T14:16:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80c6630 0x7feaf814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815b320 0x7feaf80cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf814cf60 con 0x7feaf80ca0f0 2023-08-09T14:16:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8156660 con 0x7feaf80c6630 2023-08-09T14:16:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feb0020b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8156ec0 con 0x7feaf815b320 2023-08-09T14:16:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feafd7a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feafd7a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44716/0 (socket says 172.21.15.5:44716) 2023-08-09T14:16:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feafd7a6700 1 -- 172.21.15.5:0/1961097229 learned_addr learned my addr 172.21.15.5:0/1961097229 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feafe7a8700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815b320 0x7feaf80cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.934+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80c6630 0x7feaf814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 -- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815b320 msgr2=0x7feaf80cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815b320 0x7feaf80cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 -- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80c6630 msgr2=0x7feaf814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80c6630 0x7feaf814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 -- 172.21.15.5:0/1961097229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009550 con 0x7feaf80ca0f0 2023-08-09T14:16:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feafd7a6700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c7f0 tx=0x7feaf400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011800 con 0x7feaf80ca0f0 2023-08-09T14:16:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4011960 con 0x7feaf80ca0f0 2023-08-09T14:16:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011cf0 con 0x7feaf80ca0f0 2023-08-09T14:16:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf8156900 con 0x7feaf80ca0f0 2023-08-09T14:16:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.935+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80ac950 con 0x7feaf80ca0f0 2023-08-09T14:16:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.936+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8074600 con 0x7feaf80ca0f0 2023-08-09T14:16:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.937+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feaf4018360 con 0x7feaf80ca0f0 2023-08-09T14:16:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.937+0000 7feaee7fc700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 0x7feadc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.937+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf4088230 con 0x7feaf80ca0f0 2023-08-09T14:16:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.937+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 0x7feadc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.938+0000 7feafdfa7700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 0x7feadc06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feae8014040 tx=0x7feae8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:30.942+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feaf40539b0 con 0x7feaf80ca0f0 2023-08-09T14:16:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.141+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf80cbd20 con 0x7feaf80ca0f0 2023-08-09T14:16:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.143+0000 7feaee7fc700 1 -- 172.21.15.5:0/1961097229 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18245 (secure 0 0 0) 0x7feaf4056fd0 con 0x7feaf80ca0f0 2023-08-09T14:16:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:31.146 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:16:28.368210+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:16:25.137999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T14:16:25.743028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:16:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 msgr2=0x7feadc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 0x7feadc06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feae8014040 tx=0x7feae8008030 comp rx=0 tx=0).stop 2023-08-09T14:16:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 msgr2=0x7feaf80ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c7f0 tx=0x7feaf400cb00 comp rx=0 tx=0).stop 2023-08-09T14:16:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 shutdown_connections 2023-08-09T14:16:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7feadc06a0e0 0x7feadc06c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7feaf815b320 0x7feaf80cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7feaf80c6630 0x7feaf814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 --2- 172.21.15.5:0/1961097229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80ca0f0 0x7feaf80ce790 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 >> 172.21.15.5:0/1961097229 conn(0x7feaf80cf560 msgr2=0x7feaf8157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 shutdown_connections 2023-08-09T14:16:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.145+0000 7feb0020b700 1 -- 172.21.15.5:0/1961097229 wait complete. 2023-08-09T14:16:31.159 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T14:16:31.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:16:31.256 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-08-09T14:16:31.254+0000 7f9a1cc96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T14:16:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.282+0000 7f1bece2f700 1 Processor -- start 2023-08-09T14:16:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.282+0000 7f1bece2f700 1 -- start start 2023-08-09T14:16:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.283+0000 7f1bece2f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1be806a1c0 0x7f1be806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.283+0000 7f1bece2f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80ce050 con 0x7f1be815d400 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.283+0000 7f1bece2f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be806e850 con 0x7f1be80cc780 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.283+0000 7f1bece2f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be806ab80 con 0x7f1be806a1c0 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1be806a1c0 0x7f1be806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1be806a1c0 0x7f1be806a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44724/0 (socket says 172.21.15.5:44724) 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1be815d400 0x7f1be80cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58140/0 (socket says 172.21.15.5:58140) 2023-08-09T14:16:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 -- 172.21.15.5:0/2058499566 learned_addr learned my addr 172.21.15.5:0/2058499566 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 -- 172.21.15.5:0/2058499566 >> v1:172.21.15.101:6789/0 conn(0x7f1be80cc780 legacy=0x7f1be80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 -- 172.21.15.5:0/2058499566 >> v1:172.21.15.5:6789/0 conn(0x7f1be815d400 legacy=0x7f1be80cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 -- 172.21.15.5:0/2058499566 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80cf7b0 con 0x7f1be806a1c0 2023-08-09T14:16:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be5d9b700 1 --2- 172.21.15.5:0/2058499566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be806a1c0 0x7f1be806a640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80098f0 tx=0x7f1bd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e59a4ede588217 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be559a700 1 -- 172.21.15.5:0/2058499566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800b8a0 con 0x7f1be806a1c0 2023-08-09T14:16:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be559a700 1 -- 172.21.15.5:0/2058499566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800ba00 con 0x7f1be806a1c0 2023-08-09T14:16:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.284+0000 7f1be559a700 1 -- 172.21.15.5:0/2058499566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800bd90 con 0x7f1be806a1c0 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 -- 172.21.15.5:0/2058499566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be806a1c0 msgr2=0x7f1be806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 --2- 172.21.15.5:0/2058499566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be806a1c0 0x7f1be806a640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80098f0 tx=0x7f1bd8009c00 comp rx=0 tx=0).stop 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 -- 172.21.15.5:0/2058499566 shutdown_connections 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 --2- 172.21.15.5:0/2058499566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be806a1c0 0x7f1be806a640 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 -- 172.21.15.5:0/2058499566 >> 172.21.15.5:0/2058499566 conn(0x7f1be80b1900 msgr2=0x7f1be80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 -- 172.21.15.5:0/2058499566 shutdown_connections 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.285+0000 7f1bece2f700 1 -- 172.21.15.5:0/2058499566 wait complete. 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.286+0000 7f1bece2f700 1 Processor -- start 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.286+0000 7f1bece2f700 1 -- start start 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1be806a1c0 0x7f1be81618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1be80cc780 0x7f1be814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8161440 con 0x7f1be815d400 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8160830 con 0x7f1be806a1c0 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1bece2f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8160b10 con 0x7f1be80cc780 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44732/0 (socket says 172.21.15.5:44732) 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 -- 172.21.15.5:0/1012938476 learned_addr learned my addr 172.21.15.5:0/1012938476 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be659c700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1be806a1c0 0x7f1be81618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be5d9b700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1be80cc780 0x7f1be814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 -- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1be80cc780 msgr2=0x7f1be814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1be80cc780 0x7f1be814a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 -- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1be806a1c0 msgr2=0x7f1be81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1be806a1c0 0x7f1be81618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.287+0000 7f1be6d9d700 1 -- 172.21.15.5:0/1012938476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8009550 con 0x7f1be815d400 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1be6d9d700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1be000cc50 tx=0x7f1be000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0003c00 con 0x7f1be815d400 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0003d60 con 0x7f1be815d400 2023-08-09T14:16:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be8160df0 con 0x7f1be815d400 2023-08-09T14:16:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000aab0 con 0x7f1be815d400 2023-08-09T14:16:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.288+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be814a680 con 0x7f1be815d400 2023-08-09T14:16:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.289+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be81615b0 con 0x7f1be815d400 2023-08-09T14:16:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.289+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1be000ac10 con 0x7f1be815d400 2023-08-09T14:16:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.290+0000 7f1bdeffd700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 0x7f1bc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.290+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1be0088590 con 0x7f1be815d400 2023-08-09T14:16:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.290+0000 7f1be659c700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 0x7f1bc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.290+0000 7f1be659c700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 0x7f1bc806c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000f60 tx=0x7f1bd0007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.294+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1be0053bf0 con 0x7f1be815d400 2023-08-09T14:16:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.490+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1be806e200 con 0x7f1bc806a0e0 2023-08-09T14:16:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.499+0000 7f1bdeffd700 1 -- 172.21.15.5:0/1012938476 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306297 (secure 0 0 0) 0x7f1bd0001330 con 0x7f1bc806a0e0 2023-08-09T14:16:31.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 msgr2=0x7f1bc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 0x7f1bc806c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000f60 tx=0x7f1bd0007ed0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 msgr2=0x7f1be8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1be000cc50 tx=0x7f1be000cf60 comp rx=0 tx=0).stop 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 shutdown_connections 2023-08-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f1bc806a0e0 0x7f1bc806c5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be815d400 0x7f1be8159dc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f1be806a1c0 0x7f1be81618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 --2- 172.21.15.5:0/1012938476 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f1be80cc780 0x7f1be814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.502+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 >> 172.21.15.5:0/1012938476 conn(0x7f1be80b1900 msgr2=0x7f1be806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.503+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 shutdown_connections 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.503+0000 7f1bece2f700 1 -- 172.21.15.5:0/1012938476 wait complete. 2023-08-09T14:16:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:16:31.517 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-08-09T14:16:29.797759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220216,"kb_used_data":4004,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754504,"statfs":{"total":773094113280,"available":772868612096,"internally_reserved":0,"allocated":4100096,"data_stored":2355969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.444394"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376592+0000","last_change":"2023-08-09T14:16:27.392681+0000","last_active":"2023-08-09T14:16:28.376592+0000","last_peered":"2023-08-09T14:16:28.376592+0000","last_clean":"2023-08-09T14:16:28.376592+0000","last_became_active":"2023-08-09T14:16:27.392375+0000","last_became_peered":"2023-08-09T14:16:27.392375+0000","last_unstale":"2023-08-09T14:16:28.376592+0000","last_undegraded":"2023-08-09T14:16:28.376592+0000","last_fullsized":"2023-08-09T14:16:28.376592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:17.566182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376186+0000","last_change":"2023-08-09T14:16:27.382765+0000","last_active":"2023-08-09T14:16:28.376186+0000","last_peered":"2023-08-09T14:16:28.376186+0000","last_clean":"2023-08-09T14:16:28.376186+0000","last_became_active":"2023-08-09T14:16:27.382452+0000","last_became_peered":"2023-08-09T14:16:27.382452+0000","last_unstale":"2023-08-09T14:16:28.376186+0000","last_undegraded":"2023-08-09T14:16:28.376186+0000","last_fullsized":"2023-08-09T14:16:28.376186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:12.137580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477610+0000","last_change":"2023-08-09T14:16:27.378464+0000","last_active":"2023-08-09T14:16:28.477610+0000","last_peered":"2023-08-09T14:16:28.477610+0000","last_clean":"2023-08-09T14:16:28.477610+0000","last_became_active":"2023-08-09T14:16:27.378127+0000","last_became_peered":"2023-08-09T14:16:27.378127+0000","last_unstale":"2023-08-09T14:16:28.477610+0000","last_undegraded":"2023-08-09T14:16:28.477610+0000","last_fullsized":"2023-08-09T14:16:28.477610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:10.775803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635453+0000","last_change":"2023-08-09T14:16:27.369618+0000","last_active":"2023-08-09T14:16:28.635453+0000","last_peered":"2023-08-09T14:16:28.635453+0000","last_clean":"2023-08-09T14:16:28.635453+0000","last_became_active":"2023-08-09T14:16:27.369287+0000","last_became_peered":"2023-08-09T14:16:27.369287+0000","last_unstale":"2023-08-09T14:16:28.635453+0000","last_undegraded":"2023-08-09T14:16:28.635453+0000","last_fullsized":"2023-08-09T14:16:28.635453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:00:52.970600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635701+0000","last_change":"2023-08-09T14:16:27.378759+0000","last_active":"2023-08-09T14:16:28.635701+0000","last_peered":"2023-08-09T14:16:28.635701+0000","last_clean":"2023-08-09T14:16:28.635701+0000","last_became_active":"2023-08-09T14:16:27.378489+0000","last_became_peered":"2023-08-09T14:16:27.378489+0000","last_unstale":"2023-08-09T14:16:28.635701+0000","last_undegraded":"2023-08-09T14:16:28.635701+0000","last_fullsized":"2023-08-09T14:16:28.635701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:06:19.169909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635186+0000","last_change":"2023-08-09T14:16:27.384299+0000","last_active":"2023-08-09T14:16:28.635186+0000","last_peered":"2023-08-09T14:16:28.635186+0000","last_clean":"2023-08-09T14:16:28.635186+0000","last_became_active":"2023-08-09T14:16:27.383976+0000","last_became_peered":"2023-08-09T14:16:27.383976+0000","last_unstale":"2023-08-09T14:16:28.635186+0000","last_undegraded":"2023-08-09T14:16:28.635186+0000","last_fullsized":"2023-08-09T14:16:28.635186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:31.479992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.375963+0000","last_change":"2023-08-09T14:16:27.381355+0000","last_active":"2023-08-09T14:16:28.375963+0000","last_peered":"2023-08-09T14:16:28.375963+0000","last_clean":"2023-08-09T14:16:28.375963+0000","last_became_active":"2023-08-09T14:16:27.380358+0000","last_became_peered":"2023-08-09T14:16:27.380358+0000","last_unstale":"2023-08-09T14:16:28.375963+0000","last_undegraded":"2023-08-09T14:16:28.375963+0000","last_fullsized":"2023-08-09T14:16:28.375963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:51.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477769+0000","last_change":"2023-08-09T14:16:27.384445+0000","last_active":"2023-08-09T14:16:28.477769+0000","last_peered":"2023-08-09T14:16:28.477769+0000","last_clean":"2023-08-09T14:16:28.477769+0000","last_became_active":"2023-08-09T14:16:27.384036+0000","last_became_peered":"2023-08-09T14:16:27.384036+0000","last_unstale":"2023-08-09T14:16:28.477769+0000","last_undegraded":"2023-08-09T14:16:28.477769+0000","last_fullsized":"2023-08-09T14:16:28.477769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:06:28.128390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477833+0000","last_change":"2023-08-09T14:16:27.383615+0000","last_active":"2023-08-09T14:16:28.477833+0000","last_peered":"2023-08-09T14:16:28.477833+0000","last_clean":"2023-08-09T14:16:28.477833+0000","last_became_active":"2023-08-09T14:16:27.383312+0000","last_became_peered":"2023-08-09T14:16:27.383312+0000","last_unstale":"2023-08-09T14:16:28.477833+0000","last_undegraded":"2023-08-09T14:16:28.477833+0000","last_fullsized":"2023-08-09T14:16:28.477833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:11:06.598919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378241+0000","last_change":"2023-08-09T14:16:27.378467+0000","last_active":"2023-08-09T14:16:28.378241+0000","last_peered":"2023-08-09T14:16:28.378241+0000","last_clean":"2023-08-09T14:16:28.378241+0000","last_became_active":"2023-08-09T14:16:27.378209+0000","last_became_peered":"2023-08-09T14:16:27.378209+0000","last_unstale":"2023-08-09T14:16:28.378241+0000","last_undegraded":"2023-08-09T14:16:28.378241+0000","last_fullsized":"2023-08-09T14:16:28.378241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:59.049900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378492+0000","last_change":"2023-08-09T14:16:27.382940+0000","last_active":"2023-08-09T14:16:28.378492+0000","last_peered":"2023-08-09T14:16:28.378492+0000","last_clean":"2023-08-09T14:16:28.378492+0000","last_became_active":"2023-08-09T14:16:27.382676+0000","last_became_peered":"2023-08-09T14:16:27.382676+0000","last_unstale":"2023-08-09T14:16:28.378492+0000","last_undegraded":"2023-08-09T14:16:28.378492+0000","last_fullsized":"2023-08-09T14:16:28.378492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:03.077867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635270+0000","last_change":"2023-08-09T14:16:27.380065+0000","last_active":"2023-08-09T14:16:28.635270+0000","last_peered":"2023-08-09T14:16:28.635270+0000","last_clean":"2023-08-09T14:16:28.635270+0000","last_became_active":"2023-08-09T14:16:27.379799+0000","last_became_peered":"2023-08-09T14:16:27.379799+0000","last_unstale":"2023-08-09T14:16:28.635270+0000","last_undegraded":"2023-08-09T14:16:28.635270+0000","last_fullsized":"2023-08-09T14:16:28.635270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:07:43.837022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378951+0000","last_change":"2023-08-09T14:16:27.383386+0000","last_active":"2023-08-09T14:16:28.378951+0000","last_peered":"2023-08-09T14:16:28.378951+0000","last_clean":"2023-08-09T14:16:28.378951+0000","last_became_active":"2023-08-09T14:16:27.383106+0000","last_became_peered":"2023-08-09T14:16:27.383106+0000","last_unstale":"2023-08-09T14:16:28.378951+0000","last_undegraded":"2023-08-09T14:16:28.378951+0000","last_fullsized":"2023-08-09T14:16:28.378951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:58.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635016+0000","last_change":"2023-08-09T14:16:27.379467+0000","last_active":"2023-08-09T14:16:28.635016+0000","last_peered":"2023-08-09T14:16:28.635016+0000","last_clean":"2023-08-09T14:16:28.635016+0000","last_became_active":"2023-08-09T14:16:27.378151+0000","last_became_peered":"2023-08-09T14:16:27.378151+0000","last_unstale":"2023-08-09T14:16:28.635016+0000","last_undegraded":"2023-08-09T14:16:28.635016+0000","last_fullsized":"2023-08-09T14:16:28.635016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:02:52.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635145+0000","last_change":"2023-08-09T14:16:27.381598+0000","last_active":"2023-08-09T14:16:28.635145+0000","last_peered":"2023-08-09T14:16:28.635145+0000","last_clean":"2023-08-09T14:16:28.635145+0000","last_became_active":"2023-08-09T14:16:27.380971+0000","last_became_peered":"2023-08-09T14:16:27.380971+0000","last_unstale":"2023-08-09T14:16:28.635145+0000","last_undegraded":"2023-08-09T14:16:28.635145+0000","last_fullsized":"2023-08-09T14:16:28.635145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:24:53.297067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378769+0000","last_change":"2023-08-09T14:16:27.380374+0000","last_active":"2023-08-09T14:16:28.378769+0000","last_peered":"2023-08-09T14:16:28.378769+0000","last_clean":"2023-08-09T14:16:28.378769+0000","last_became_active":"2023-08-09T14:16:27.380104+0000","last_became_peered":"2023-08-09T14:16:27.380104+0000","last_unstale":"2023-08-09T14:16:28.378769+0000","last_undegraded":"2023-08-09T14:16:28.378769+0000","last_fullsized":"2023-08-09T14:16:28.378769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:56.739317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634703+0000","last_change":"2023-08-09T14:16:27.374314+0000","last_active":"2023-08-09T14:16:28.634703+0000","last_peered":"2023-08-09T14:16:28.634703+0000","last_clean":"2023-08-09T14:16:28.634703+0000","last_became_active":"2023-08-09T14:16:27.372540+0000","last_became_peered":"2023-08-09T14:16:27.372540+0000","last_unstale":"2023-08-09T14:16:28.634703+0000","last_undegraded":"2023-08-09T14:16:28.634703+0000","last_fullsized":"2023-08-09T14:16:28.634703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:32.498787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378668+0000","last_change":"2023-08-09T14:16:27.384513+0000","last_active":"2023-08-09T14:16:28.378668+0000","last_peered":"2023-08-09T14:16:28.378668+0000","last_clean":"2023-08-09T14:16:28.378668+0000","last_became_active":"2023-08-09T14:16:27.384181+0000","last_became_peered":"2023-08-09T14:16:27.384181+0000","last_unstale":"2023-08-09T14:16:28.378668+0000","last_undegraded":"2023-08-09T14:16:28.378668+0000","last_fullsized":"2023-08-09T14:16:28.378668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:55.924848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635445+0000","last_change":"2023-08-09T14:16:27.388580+0000","last_active":"2023-08-09T14:16:28.635445+0000","last_peered":"2023-08-09T14:16:28.635445+0000","last_clean":"2023-08-09T14:16:28.635445+0000","last_became_active":"2023-08-09T14:16:27.388267+0000","last_became_peered":"2023-08-09T14:16:27.388267+0000","last_unstale":"2023-08-09T14:16:28.635445+0000","last_undegraded":"2023-08-09T14:16:28.635445+0000","last_fullsized":"2023-08-09T14:16:28.635445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:10:45.851712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477855+0000","last_change":"2023-08-09T14:16:26.375491+0000","last_active":"2023-08-09T14:16:28.477855+0000","last_peered":"2023-08-09T14:16:28.477855+0000","last_clean":"2023-08-09T14:16:28.477855+0000","last_became_active":"2023-08-09T14:16:26.375132+0000","last_became_peered":"2023-08-09T14:16:26.375132+0000","last_unstale":"2023-08-09T14:16:28.477855+0000","last_undegraded":"2023-08-09T14:16:28.477855+0000","last_fullsized":"2023-08-09T14:16:28.477855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:50.550366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635521+0000","last_change":"2023-08-09T14:16:26.373918+0000","last_active":"2023-08-09T14:16:28.635521+0000","last_peered":"2023-08-09T14:16:28.635521+0000","last_clean":"2023-08-09T14:16:28.635521+0000","last_became_active":"2023-08-09T14:16:26.373603+0000","last_became_peered":"2023-08-09T14:16:26.373603+0000","last_unstale":"2023-08-09T14:16:28.635521+0000","last_undegraded":"2023-08-09T14:16:28.635521+0000","last_fullsized":"2023-08-09T14:16:28.635521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:54.912864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376415+0000","last_change":"2023-08-09T14:16:27.385932+0000","last_active":"2023-08-09T14:16:28.376415+0000","last_peered":"2023-08-09T14:16:28.376415+0000","last_clean":"2023-08-09T14:16:28.376415+0000","last_became_active":"2023-08-09T14:16:27.385647+0000","last_became_peered":"2023-08-09T14:16:27.385647+0000","last_unstale":"2023-08-09T14:16:28.376415+0000","last_undegraded":"2023-08-09T14:16:28.376415+0000","last_fullsized":"2023-08-09T14:16:28.376415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:08.395065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477444+0000","last_change":"2023-08-09T14:16:27.379559+0000","last_active":"2023-08-09T14:16:28.477444+0000","last_peered":"2023-08-09T14:16:28.477444+0000","last_clean":"2023-08-09T14:16:28.477444+0000","last_became_active":"2023-08-09T14:16:27.379094+0000","last_became_peered":"2023-08-09T14:16:27.379094+0000","last_unstale":"2023-08-09T14:16:28.477444+0000","last_undegraded":"2023-08-09T14:16:28.477444+0000","last_fullsized":"2023-08-09T14:16:28.477444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:46:07.290988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378879+0000","last_change":"2023-08-09T14:16:26.379636+0000","last_active":"2023-08-09T14:16:28.378879+0000","last_peered":"2023-08-09T14:16:28.378879+0000","last_clean":"2023-08-09T14:16:28.378879+0000","last_became_active":"2023-08-09T14:16:26.379318+0000","last_became_peered":"2023-08-09T14:16:26.379318+0000","last_unstale":"2023-08-09T14:16:28.378879+0000","last_undegraded":"2023-08-09T14:16:28.378879+0000","last_fullsized":"2023-08-09T14:16:28.378879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:31.116697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634801+0000","last_change":"2023-08-09T14:16:26.371871+0000","last_active":"2023-08-09T14:16:28.634801+0000","last_peered":"2023-08-09T14:16:28.634801+0000","last_clean":"2023-08-09T14:16:28.634801+0000","last_became_active":"2023-08-09T14:16:26.371539+0000","last_became_peered":"2023-08-09T14:16:26.371539+0000","last_unstale":"2023-08-09T14:16:28.634801+0000","last_undegraded":"2023-08-09T14:16:28.634801+0000","last_fullsized":"2023-08-09T14:16:28.634801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:10.548088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376380+0000","last_change":"2023-08-09T14:16:27.383425+0000","last_active":"2023-08-09T14:16:28.376380+0000","last_peered":"2023-08-09T14:16:28.376380+0000","last_clean":"2023-08-09T14:16:28.376380+0000","last_became_active":"2023-08-09T14:16:27.383146+0000","last_became_peered":"2023-08-09T14:16:27.383146+0000","last_unstale":"2023-08-09T14:16:28.376380+0000","last_undegraded":"2023-08-09T14:16:28.376380+0000","last_fullsized":"2023-08-09T14:16:28.376380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:18.288359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635581+0000","last_change":"2023-08-09T14:16:27.379205+0000","last_active":"2023-08-09T14:16:28.635581+0000","last_peered":"2023-08-09T14:16:28.635581+0000","last_clean":"2023-08-09T14:16:28.635581+0000","last_became_active":"2023-08-09T14:16:27.378938+0000","last_became_peered":"2023-08-09T14:16:27.378938+0000","last_unstale":"2023-08-09T14:16:28.635581+0000","last_undegraded":"2023-08-09T14:16:28.635581+0000","last_fullsized":"2023-08-09T14:16:28.635581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:02:57.239781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376430+0000","last_change":"2023-08-09T14:16:26.368660+0000","last_active":"2023-08-09T14:16:28.376430+0000","last_peered":"2023-08-09T14:16:28.376430+0000","last_clean":"2023-08-09T14:16:28.376430+0000","last_became_active":"2023-08-09T14:16:26.368331+0000","last_became_peered":"2023-08-09T14:16:26.368331+0000","last_unstale":"2023-08-09T14:16:28.376430+0000","last_undegraded":"2023-08-09T14:16:28.376430+0000","last_fullsized":"2023-08-09T14:16:28.376430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:27:11.429564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378574+0000","last_change":"2023-08-09T14:16:27.377384+0000","last_active":"2023-08-09T14:16:28.378574+0000","last_peered":"2023-08-09T14:16:28.378574+0000","last_clean":"2023-08-09T14:16:28.378574+0000","last_became_active":"2023-08-09T14:16:27.377112+0000","last_became_peered":"2023-08-09T14:16:27.377112+0000","last_unstale":"2023-08-09T14:16:28.378574+0000","last_undegraded":"2023-08-09T14:16:28.378574+0000","last_fullsized":"2023-08-09T14:16:28.378574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:07:33.983649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477772+0000","last_change":"2023-08-09T14:16:27.392373+0000","last_active":"2023-08-09T14:16:28.477772+0000","last_peered":"2023-08-09T14:16:28.477772+0000","last_clean":"2023-08-09T14:16:28.477772+0000","last_became_active":"2023-08-09T14:16:27.392049+0000","last_became_peered":"2023-08-09T14:16:27.392049+0000","last_unstale":"2023-08-09T14:16:28.477772+0000","last_undegraded":"2023-08-09T14:16:28.477772+0000","last_fullsized":"2023-08-09T14:16:28.477772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:01:16.518575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376373+0000","last_change":"2023-08-09T14:16:26.372916+0000","last_active":"2023-08-09T14:16:28.376373+0000","last_peered":"2023-08-09T14:16:28.376373+0000","last_clean":"2023-08-09T14:16:28.376373+0000","last_became_active":"2023-08-09T14:16:26.372596+0000","last_became_peered":"2023-08-09T14:16:26.372596+0000","last_unstale":"2023-08-09T14:16:28.376373+0000","last_undegraded":"2023-08-09T14:16:28.376373+0000","last_fullsized":"2023-08-09T14:16:28.376373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:28.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477606+0000","last_change":"2023-08-09T14:16:27.382774+0000","last_active":"2023-08-09T14:16:28.477606+0000","last_peered":"2023-08-09T14:16:28.477606+0000","last_clean":"2023-08-09T14:16:28.477606+0000","last_became_active":"2023-08-09T14:16:27.379469+0000","last_became_peered":"2023-08-09T14:16:27.379469+0000","last_unstale":"2023-08-09T14:16:28.477606+0000","last_undegraded":"2023-08-09T14:16:28.477606+0000","last_fullsized":"2023-08-09T14:16:28.477606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:12.373924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376543+0000","last_change":"2023-08-09T14:16:26.376657+0000","last_active":"2023-08-09T14:16:28.376543+0000","last_peered":"2023-08-09T14:16:28.376543+0000","last_clean":"2023-08-09T14:16:28.376543+0000","last_became_active":"2023-08-09T14:16:26.376314+0000","last_became_peered":"2023-08-09T14:16:26.376314+0000","last_unstale":"2023-08-09T14:16:28.376543+0000","last_undegraded":"2023-08-09T14:16:28.376543+0000","last_fullsized":"2023-08-09T14:16:28.376543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:06:34.339530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376324+0000","last_change":"2023-08-09T14:16:27.392552+0000","last_active":"2023-08-09T14:16:28.376324+0000","last_peered":"2023-08-09T14:16:28.376324+0000","last_clean":"2023-08-09T14:16:28.376324+0000","last_became_active":"2023-08-09T14:16:27.392251+0000","last_became_peered":"2023-08-09T14:16:27.392251+0000","last_unstale":"2023-08-09T14:16:28.376324+0000","last_undegraded":"2023-08-09T14:16:28.376324+0000","last_fullsized":"2023-08-09T14:16:28.376324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:40.643634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635317+0000","last_change":"2023-08-09T14:16:26.372527+0000","last_active":"2023-08-09T14:16:28.635317+0000","last_peered":"2023-08-09T14:16:28.635317+0000","last_clean":"2023-08-09T14:16:28.635317+0000","last_became_active":"2023-08-09T14:16:26.371439+0000","last_became_peered":"2023-08-09T14:16:26.371439+0000","last_unstale":"2023-08-09T14:16:28.635317+0000","last_undegraded":"2023-08-09T14:16:28.635317+0000","last_fullsized":"2023-08-09T14:16:28.635317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:46:00.799478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378373+0000","last_change":"2023-08-09T14:16:27.383836+0000","last_active":"2023-08-09T14:16:28.378373+0000","last_peered":"2023-08-09T14:16:28.378373+0000","last_clean":"2023-08-09T14:16:28.378373+0000","last_became_active":"2023-08-09T14:16:27.383635+0000","last_became_peered":"2023-08-09T14:16:27.383635+0000","last_unstale":"2023-08-09T14:16:28.378373+0000","last_undegraded":"2023-08-09T14:16:28.378373+0000","last_fullsized":"2023-08-09T14:16:28.378373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:54.847828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376365+0000","last_change":"2023-08-09T14:16:27.393209+0000","last_active":"2023-08-09T14:16:28.376365+0000","last_peered":"2023-08-09T14:16:28.376365+0000","last_clean":"2023-08-09T14:16:28.376365+0000","last_became_active":"2023-08-09T14:16:27.391935+0000","last_became_peered":"2023-08-09T14:16:27.391935+0000","last_unstale":"2023-08-09T14:16:28.376365+0000","last_undegraded":"2023-08-09T14:16:28.376365+0000","last_fullsized":"2023-08-09T14:16:28.376365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:34.278389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378382+0000","last_change":"2023-08-09T14:16:26.375153+0000","last_active":"2023-08-09T14:16:28.378382+0000","last_peered":"2023-08-09T14:16:28.378382+0000","last_clean":"2023-08-09T14:16:28.378382+0000","last_became_active":"2023-08-09T14:16:26.374863+0000","last_became_peered":"2023-08-09T14:16:26.374863+0000","last_unstale":"2023-08-09T14:16:28.378382+0000","last_undegraded":"2023-08-09T14:16:28.378382+0000","last_fullsized":"2023-08-09T14:16:28.378382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:34:46.131017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376213+0000","last_change":"2023-08-09T14:16:27.382903+0000","last_active":"2023-08-09T14:16:28.376213+0000","last_peered":"2023-08-09T14:16:28.376213+0000","last_clean":"2023-08-09T14:16:28.376213+0000","last_became_active":"2023-08-09T14:16:27.382532+0000","last_became_peered":"2023-08-09T14:16:27.382532+0000","last_unstale":"2023-08-09T14:16:28.376213+0000","last_undegraded":"2023-08-09T14:16:28.376213+0000","last_fullsized":"2023-08-09T14:16:28.376213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:44.119989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635435+0000","last_change":"2023-08-09T14:16:26.372562+0000","last_active":"2023-08-09T14:16:28.635435+0000","last_peered":"2023-08-09T14:16:28.635435+0000","last_clean":"2023-08-09T14:16:28.635435+0000","last_became_active":"2023-08-09T14:16:26.372128+0000","last_became_peered":"2023-08-09T14:16:26.372128+0000","last_unstale":"2023-08-09T14:16:28.635435+0000","last_undegraded":"2023-08-09T14:16:28.635435+0000","last_fullsized":"2023-08-09T14:16:28.635435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:40.775094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635289+0000","last_change":"2023-08-09T14:16:27.374486+0000","last_active":"2023-08-09T14:16:28.635289+0000","last_peered":"2023-08-09T14:16:28.635289+0000","last_clean":"2023-08-09T14:16:28.635289+0000","last_became_active":"2023-08-09T14:16:27.374178+0000","last_became_peered":"2023-08-09T14:16:27.374178+0000","last_unstale":"2023-08-09T14:16:28.635289+0000","last_undegraded":"2023-08-09T14:16:28.635289+0000","last_fullsized":"2023-08-09T14:16:28.635289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:37.463455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635128+0000","last_change":"2023-08-09T14:16:26.374002+0000","last_active":"2023-08-09T14:16:28.635128+0000","last_peered":"2023-08-09T14:16:28.635128+0000","last_clean":"2023-08-09T14:16:28.635128+0000","last_became_active":"2023-08-09T14:16:26.373657+0000","last_became_peered":"2023-08-09T14:16:26.373657+0000","last_unstale":"2023-08-09T14:16:28.635128+0000","last_undegraded":"2023-08-09T14:16:28.635128+0000","last_fullsized":"2023-08-09T14:16:28.635128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:19.612548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379016+0000","last_change":"2023-08-09T14:16:27.386594+0000","last_active":"2023-08-09T14:16:28.379016+0000","last_peered":"2023-08-09T14:16:28.379016+0000","last_clean":"2023-08-09T14:16:28.379016+0000","last_became_active":"2023-08-09T14:16:27.385405+0000","last_became_peered":"2023-08-09T14:16:27.385405+0000","last_unstale":"2023-08-09T14:16:28.379016+0000","last_undegraded":"2023-08-09T14:16:28.379016+0000","last_fullsized":"2023-08-09T14:16:28.379016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:15:57.328282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635660+0000","last_change":"2023-08-09T14:16:26.376107+0000","last_active":"2023-08-09T14:16:28.635660+0000","last_peered":"2023-08-09T14:16:28.635660+0000","last_clean":"2023-08-09T14:16:28.635660+0000","last_became_active":"2023-08-09T14:16:26.375835+0000","last_became_peered":"2023-08-09T14:16:26.375835+0000","last_unstale":"2023-08-09T14:16:28.635660+0000","last_undegraded":"2023-08-09T14:16:28.635660+0000","last_fullsized":"2023-08-09T14:16:28.635660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:50:04.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477520+0000","last_change":"2023-08-09T14:16:27.392363+0000","last_active":"2023-08-09T14:16:28.477520+0000","last_peered":"2023-08-09T14:16:28.477520+0000","last_clean":"2023-08-09T14:16:28.477520+0000","last_became_active":"2023-08-09T14:16:27.392066+0000","last_became_peered":"2023-08-09T14:16:27.392066+0000","last_unstale":"2023-08-09T14:16:28.477520+0000","last_undegraded":"2023-08-09T14:16:28.477520+0000","last_fullsized":"2023-08-09T14:16:28.477520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:29:16.219322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635132+0000","last_change":"2023-08-09T14:16:26.375485+0000","last_active":"2023-08-09T14:16:28.635132+0000","last_peered":"2023-08-09T14:16:28.635132+0000","last_clean":"2023-08-09T14:16:28.635132+0000","last_became_active":"2023-08-09T14:16:26.375182+0000","last_became_peered":"2023-08-09T14:16:26.375182+0000","last_unstale":"2023-08-09T14:16:28.635132+0000","last_undegraded":"2023-08-09T14:16:28.635132+0000","last_fullsized":"2023-08-09T14:16:28.635132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:50:35.784426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378972+0000","last_change":"2023-08-09T14:16:26.377424+0000","last_active":"2023-08-09T14:16:28.378972+0000","last_peered":"2023-08-09T14:16:28.378972+0000","last_clean":"2023-08-09T14:16:28.378972+0000","last_became_active":"2023-08-09T14:16:26.377107+0000","last_became_peered":"2023-08-09T14:16:26.377107+0000","last_unstale":"2023-08-09T14:16:28.378972+0000","last_undegraded":"2023-08-09T14:16:28.378972+0000","last_fullsized":"2023-08-09T14:16:28.378972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:06:06.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376182+0000","last_change":"2023-08-09T14:16:27.384099+0000","last_active":"2023-08-09T14:16:28.376182+0000","last_peered":"2023-08-09T14:16:28.376182+0000","last_clean":"2023-08-09T14:16:28.376182+0000","last_became_active":"2023-08-09T14:16:27.383700+0000","last_became_peered":"2023-08-09T14:16:27.383700+0000","last_unstale":"2023-08-09T14:16:28.376182+0000","last_undegraded":"2023-08-09T14:16:28.376182+0000","last_fullsized":"2023-08-09T14:16:28.376182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:33:14.979520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634943+0000","last_change":"2023-08-09T14:16:26.376823+0000","last_active":"2023-08-09T14:16:28.634943+0000","last_peered":"2023-08-09T14:16:28.634943+0000","last_clean":"2023-08-09T14:16:28.634943+0000","last_became_active":"2023-08-09T14:16:26.376580+0000","last_became_peered":"2023-08-09T14:16:26.376580+0000","last_unstale":"2023-08-09T14:16:28.634943+0000","last_undegraded":"2023-08-09T14:16:28.634943+0000","last_fullsized":"2023-08-09T14:16:28.634943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:50:40.937719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-09T14:16:20.265259+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:16:20.265259+0000","last_peered":"2023-08-09T14:16:20.265259+0000","last_clean":"2023-08-09T14:16:20.265259+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:16:20.265259+0000","last_undegraded":"2023-08-09T14:16:20.265259+0000","last_fullsized":"2023-08-09T14:16:20.265259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:12.248592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378990+0000","last_change":"2023-08-09T14:16:27.376561+0000","last_active":"2023-08-09T14:16:28.378990+0000","last_peered":"2023-08-09T14:16:28.378990+0000","last_clean":"2023-08-09T14:16:28.378990+0000","last_became_active":"2023-08-09T14:16:27.376153+0000","last_became_peered":"2023-08-09T14:16:27.376153+0000","last_unstale":"2023-08-09T14:16:28.378990+0000","last_undegraded":"2023-08-09T14:16:28.378990+0000","last_fullsized":"2023-08-09T14:16:28.378990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:28.448641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376068+0000","last_change":"2023-08-09T14:16:26.368097+0000","last_active":"2023-08-09T14:16:28.376068+0000","last_peered":"2023-08-09T14:16:28.376068+0000","last_clean":"2023-08-09T14:16:28.376068+0000","last_became_active":"2023-08-09T14:16:26.367758+0000","last_became_peered":"2023-08-09T14:16:26.367758+0000","last_unstale":"2023-08-09T14:16:28.376068+0000","last_undegraded":"2023-08-09T14:16:28.376068+0000","last_fullsized":"2023-08-09T14:16:28.376068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:05.197664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376480+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:16:28.376480+0000","last_peered":"2023-08-09T14:16:28.376480+0000","last_clean":"2023-08-09T14:16:28.376480+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:16:28.376480+0000","last_undegraded":"2023-08-09T14:16:28.376480+0000","last_fullsized":"2023-08-09T14:16:28.376480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:17.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635109+0000","last_change":"2023-08-09T14:16:27.384178+0000","last_active":"2023-08-09T14:16:28.635109+0000","last_peered":"2023-08-09T14:16:28.635109+0000","last_clean":"2023-08-09T14:16:28.635109+0000","last_became_active":"2023-08-09T14:16:27.381376+0000","last_became_peered":"2023-08-09T14:16:27.381376+0000","last_unstale":"2023-08-09T14:16:28.635109+0000","last_undegraded":"2023-08-09T14:16:28.635109+0000","last_fullsized":"2023-08-09T14:16:28.635109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:49:04.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634899+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:16:28.634899+0000","last_peered":"2023-08-09T14:16:28.634899+0000","last_clean":"2023-08-09T14:16:28.634899+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:16:28.634899+0000","last_undegraded":"2023-08-09T14:16:28.634899+0000","last_fullsized":"2023-08-09T14:16:28.634899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:10.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378715+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:16:28.378715+0000","last_peered":"2023-08-09T14:16:28.378715+0000","last_clean":"2023-08-09T14:16:28.378715+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:16:28.378715+0000","last_undegraded":"2023-08-09T14:16:28.378715+0000","last_fullsized":"2023-08-09T14:16:28.378715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:29:35.910977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378849+0000","last_change":"2023-08-09T14:16:27.377465+0000","last_active":"2023-08-09T14:16:28.378849+0000","last_peered":"2023-08-09T14:16:28.378849+0000","last_clean":"2023-08-09T14:16:28.378849+0000","last_became_active":"2023-08-09T14:16:27.377158+0000","last_became_peered":"2023-08-09T14:16:27.377158+0000","last_unstale":"2023-08-09T14:16:28.378849+0000","last_undegraded":"2023-08-09T14:16:28.378849+0000","last_fullsized":"2023-08-09T14:16:28.378849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:11:27.476698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635310+0000","last_change":"2023-08-09T14:16:26.372469+0000","last_active":"2023-08-09T14:16:28.635310+0000","last_peered":"2023-08-09T14:16:28.635310+0000","last_clean":"2023-08-09T14:16:28.635310+0000","last_became_active":"2023-08-09T14:16:26.372109+0000","last_became_peered":"2023-08-09T14:16:26.372109+0000","last_unstale":"2023-08-09T14:16:28.635310+0000","last_undegraded":"2023-08-09T14:16:28.635310+0000","last_fullsized":"2023-08-09T14:16:28.635310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:42:33.333444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378495+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:16:28.378495+0000","last_peered":"2023-08-09T14:16:28.378495+0000","last_clean":"2023-08-09T14:16:28.378495+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:16:28.378495+0000","last_undegraded":"2023-08-09T14:16:28.378495+0000","last_fullsized":"2023-08-09T14:16:28.378495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:00.013767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:26.348008+0000","last_change":"2023-08-09T14:16:26.348008+0000","last_active":"2023-08-09T14:16:26.348008+0000","last_peered":"2023-08-09T14:16:26.348008+0000","last_clean":"2023-08-09T14:16:26.348008+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:26.348008+0000","last_undegraded":"2023-08-09T14:16:26.348008+0000","last_fullsized":"2023-08-09T14:16:26.348008+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378690+0000","last_change":"2023-08-09T14:16:26.374316+0000","last_active":"2023-08-09T14:16:28.378690+0000","last_peered":"2023-08-09T14:16:28.378690+0000","last_clean":"2023-08-09T14:16:28.378690+0000","last_became_active":"2023-08-09T14:16:26.374052+0000","last_became_peered":"2023-08-09T14:16:26.374052+0000","last_unstale":"2023-08-09T14:16:28.378690+0000","last_undegraded":"2023-08-09T14:16:28.378690+0000","last_fullsized":"2023-08-09T14:16:28.378690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:41:52.699907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378561+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:16:28.378561+0000","last_peered":"2023-08-09T14:16:28.378561+0000","last_clean":"2023-08-09T14:16:28.378561+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:16:28.378561+0000","last_undegraded":"2023-08-09T14:16:28.378561+0000","last_fullsized":"2023-08-09T14:16:28.378561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:35:37.981080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376212+0000","last_change":"2023-08-09T14:16:27.375603+0000","last_active":"2023-08-09T14:16:28.376212+0000","last_peered":"2023-08-09T14:16:28.376212+0000","last_clean":"2023-08-09T14:16:28.376212+0000","last_became_active":"2023-08-09T14:16:27.375251+0000","last_became_peered":"2023-08-09T14:16:27.375251+0000","last_unstale":"2023-08-09T14:16:28.376212+0000","last_undegraded":"2023-08-09T14:16:28.376212+0000","last_fullsized":"2023-08-09T14:16:28.376212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:57:30.189864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477721+0000","last_change":"2023-08-09T14:16:26.376335+0000","last_active":"2023-08-09T14:16:28.477721+0000","last_peered":"2023-08-09T14:16:28.477721+0000","last_clean":"2023-08-09T14:16:28.477721+0000","last_became_active":"2023-08-09T14:16:26.376013+0000","last_became_peered":"2023-08-09T14:16:26.376013+0000","last_unstale":"2023-08-09T14:16:28.477721+0000","last_undegraded":"2023-08-09T14:16:28.477721+0000","last_fullsized":"2023-08-09T14:16:28.477721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:31:24.371451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-09T14:16:20.265351+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:16:20.265351+0000","last_peered":"2023-08-09T14:16:20.265351+0000","last_clean":"2023-08-09T14:16:20.265351+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:16:20.265351+0000","last_undegraded":"2023-08-09T14:16:20.265351+0000","last_fullsized":"2023-08-09T14:16:20.265351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:01.495171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634762+0000","last_change":"2023-08-09T14:16:27.376232+0000","last_active":"2023-08-09T14:16:28.634762+0000","last_peered":"2023-08-09T14:16:28.634762+0000","last_clean":"2023-08-09T14:16:28.634762+0000","last_became_active":"2023-08-09T14:16:27.375907+0000","last_became_peered":"2023-08-09T14:16:27.375907+0000","last_unstale":"2023-08-09T14:16:28.634762+0000","last_undegraded":"2023-08-09T14:16:28.634762+0000","last_fullsized":"2023-08-09T14:16:28.634762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:13:30.436533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T14:16:25.343394+0000","last_change":"2023-08-09T14:16:25.343394+0000","last_active":"2023-08-09T14:16:25.343394+0000","last_peered":"2023-08-09T14:16:25.343394+0000","last_clean":"2023-08-09T14:16:25.343394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T14:16:25.343394+0000","last_undegraded":"2023-08-09T14:16:25.343394+0000","last_fullsized":"2023-08-09T14:16:25.343394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-09T14:16:20.638551+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:16:20.638551+0000","last_peered":"2023-08-09T14:16:20.638551+0000","last_clean":"2023-08-09T14:16:20.638551+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:16:20.638551+0000","last_undegraded":"2023-08-09T14:16:20.638551+0000","last_fullsized":"2023-08-09T14:16:20.638551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:55:34.850537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477526+0000","last_change":"2023-08-09T14:16:27.379363+0000","last_active":"2023-08-09T14:16:28.477526+0000","last_peered":"2023-08-09T14:16:28.477526+0000","last_clean":"2023-08-09T14:16:28.477526+0000","last_became_active":"2023-08-09T14:16:27.378777+0000","last_became_peered":"2023-08-09T14:16:27.378777+0000","last_unstale":"2023-08-09T14:16:28.477526+0000","last_undegraded":"2023-08-09T14:16:28.477526+0000","last_fullsized":"2023-08-09T14:16:28.477526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:46.068900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477706+0000","last_change":"2023-08-09T14:16:26.378918+0000","last_active":"2023-08-09T14:16:28.477706+0000","last_peered":"2023-08-09T14:16:28.477706+0000","last_clean":"2023-08-09T14:16:28.477706+0000","last_became_active":"2023-08-09T14:16:26.378658+0000","last_became_peered":"2023-08-09T14:16:26.378658+0000","last_unstale":"2023-08-09T14:16:28.477706+0000","last_undegraded":"2023-08-09T14:16:28.477706+0000","last_fullsized":"2023-08-09T14:16:28.477706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:28.378191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-09T14:16:20.638509+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:16:20.638509+0000","last_peered":"2023-08-09T14:16:20.638509+0000","last_clean":"2023-08-09T14:16:20.638509+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:16:20.638509+0000","last_undegraded":"2023-08-09T14:16:20.638509+0000","last_fullsized":"2023-08-09T14:16:20.638509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:12:20.523717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":5},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":40,"acting":40,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":131793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.58399999999999996}]},{"osd":4,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.626},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":130682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435}]},{"osd":2,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58499999999999996}]},{"osd":7,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":748830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.313}]},{"osd":3,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.248},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48299999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.373},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":158406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.27400000000000002}]},{"osd":3,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.379}]},{"osd":4,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76500000000000001}]},{"osd":7,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80100000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":750422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.746}]},{"osd":4,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":151789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.2009999999999996,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.34599999999999997}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.622},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.0539999999999998,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":0.70699999999999996}]},{"osd":7,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":152254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.31}]},{"osd":1,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":131793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.439}]},{"osd":1,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60599999999999998}]},{"osd":7,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:16:31.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T14:16:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.680+0000 7f85495b7700 1 Processor -- start 2023-08-09T14:16:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.680+0000 7f85495b7700 1 -- start start 2023-08-09T14:16:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85495b7700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85495b7700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f85440b04f0 0x7f85440b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85495b7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85440d0760 con 0x7f85440b2130 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85495b7700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85440b00d0 con 0x7f85440b04f0 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85495b7700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85440ce7f0 con 0x7f854415d5d0 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85427fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85440b2130 0x7f85440d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58152/0 (socket says 172.21.15.5:58152) 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85427fc700 1 -- 172.21.15.5:0/2821618158 learned_addr learned my addr 172.21.15.5:0/2821618158 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f85437fe700 1 --2- 172.21.15.5:0/2821618158 >> v2:172.21.15.101:3300/0 conn(0x7f85440b04f0 0x7f85440b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313990009 0 0) 0x7f85440d0760 con 0x7f85440b2130 2023-08-09T14:16:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.681+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0035b0 con 0x7f85440b2130 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f85437fe700 1 -- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 msgr2=0x7f85440d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631667905 0 0) 0x7f852c0035b0 con 0x7f85440b2130 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f85437fe700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f85437fe700 1 -- 172.21.15.5:0/2821618158 >> v1:172.21.15.5:6789/0 conn(0x7f85440b2130 legacy=0x7f85440d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f85437fe700 1 -- 172.21.15.5:0/2821618158 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440afd60 con 0x7f85440b04f0 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f85437fe700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440b0960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a3563a2057fa3b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00e070 con 0x7f85440b04f0 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c003a20 con 0x7f85440b04f0 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.682+0000 7f8541ffb700 1 -- 172.21.15.5:0/2821618158 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534001670 con 0x7f85440b04f0 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 -- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 msgr2=0x7f85440b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440b0960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c00b330 comp rx=0 tx=0).stop 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 -- 172.21.15.5:0/2821618158 shutdown_connections 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440b0960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 --2- 172.21.15.5:0/2821618158 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 -- 172.21.15.5:0/2821618158 >> 172.21.15.5:0/2821618158 conn(0x7f85440d3090 msgr2=0x7f85440d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 -- 172.21.15.5:0/2821618158 shutdown_connections 2023-08-09T14:16:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.683+0000 7f85495b7700 1 -- 172.21.15.5:0/2821618158 wait complete. 2023-08-09T14:16:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.684+0000 7f85495b7700 1 Processor -- start 2023-08-09T14:16:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.684+0000 7f85495b7700 1 -- start start 2023-08-09T14:16:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85440cc0b0 con 0x7f85440b2130 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85440caad0 con 0x7f85440b04f0 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85495b7700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85440cadb0 con 0x7f854415d5d0 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44744/0 (socket says 172.21.15.5:44744) 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 -- 172.21.15.5:0/2405461299 learned_addr learned my addr 172.21.15.5:0/2405461299 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85437fe700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 -- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 msgr2=0x7f85440ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 -- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 msgr2=0x7f85440cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85427fc700 1 -- 172.21.15.5:0/2405461299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380094a0 con 0x7f85440b2130 2023-08-09T14:16:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.685+0000 7f85437fe700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f85427fc700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f853400c780 tx=0x7f853400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534004c80 con 0x7f85440b2130 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534004de0 con 0x7f85440b2130 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85340072d0 con 0x7f85440b2130 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c009a70 con 0x7f85440b2130 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.686+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85440cb370 con 0x7f85440b2130 2023-08-09T14:16:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.687+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8544074600 con 0x7f85440b2130 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.687+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8534007430 con 0x7f85440b2130 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.687+0000 7f852b7fe700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 0x7f853006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.688+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85340877f0 con 0x7f85440b2130 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.688+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 0x7f853006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.688+0000 7f8542ffd700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 0x7f853006c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85441e7aa0 tx=0x7f8538008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.692+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8534052f70 con 0x7f85440b2130 2023-08-09T14:16:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.886+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 --> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85440ced20 con 0x7f853006a0e0 2023-08-09T14:16:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.895+0000 7f852b7fe700 1 -- 172.21.15.5:0/2405461299 <== mgr.4108 v2:172.21.15.101:6832/892658077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311846 (secure 0 0 0) 0x7f8538009a30 con 0x7f853006a0e0 2023-08-09T14:16:31.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.898+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 msgr2=0x7f853006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.898+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 0x7f853006c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85441e7aa0 tx=0x7f8538008040 comp rx=0 tx=0).stop 2023-08-09T14:16:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.898+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 msgr2=0x7f854415a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.898+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f853400c780 tx=0x7f853400cb40 comp rx=0 tx=0).stop 2023-08-09T14:16:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 shutdown_connections 2023-08-09T14:16:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f853006a0e0 0x7f853006c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f854415d5d0 0x7f85440ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f85440b04f0 0x7f85440cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 --2- 172.21.15.5:0/2405461299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85440b2130 0x7f854415a510 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 >> 172.21.15.5:0/2405461299 conn(0x7f85440d3090 msgr2=0x7f854415b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 shutdown_connections 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:31.899+0000 7f85495b7700 1 -- 172.21.15.5:0/2405461299 wait complete. 2023-08-09T14:16:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-08-09T14:16:31.913 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-08-09T14:16:31.798457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220384,"kb_used_data":4168,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754336,"statfs":{"total":773094113280,"available":772868440064,"internally_reserved":0,"allocated":4268032,"data_stored":2437004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001740"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376592+0000","last_change":"2023-08-09T14:16:27.392681+0000","last_active":"2023-08-09T14:16:28.376592+0000","last_peered":"2023-08-09T14:16:28.376592+0000","last_clean":"2023-08-09T14:16:28.376592+0000","last_became_active":"2023-08-09T14:16:27.392375+0000","last_became_peered":"2023-08-09T14:16:27.392375+0000","last_unstale":"2023-08-09T14:16:28.376592+0000","last_undegraded":"2023-08-09T14:16:28.376592+0000","last_fullsized":"2023-08-09T14:16:28.376592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:17.566182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376186+0000","last_change":"2023-08-09T14:16:27.382765+0000","last_active":"2023-08-09T14:16:28.376186+0000","last_peered":"2023-08-09T14:16:28.376186+0000","last_clean":"2023-08-09T14:16:28.376186+0000","last_became_active":"2023-08-09T14:16:27.382452+0000","last_became_peered":"2023-08-09T14:16:27.382452+0000","last_unstale":"2023-08-09T14:16:28.376186+0000","last_undegraded":"2023-08-09T14:16:28.376186+0000","last_fullsized":"2023-08-09T14:16:28.376186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:12.137580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477610+0000","last_change":"2023-08-09T14:16:27.378464+0000","last_active":"2023-08-09T14:16:28.477610+0000","last_peered":"2023-08-09T14:16:28.477610+0000","last_clean":"2023-08-09T14:16:28.477610+0000","last_became_active":"2023-08-09T14:16:27.378127+0000","last_became_peered":"2023-08-09T14:16:27.378127+0000","last_unstale":"2023-08-09T14:16:28.477610+0000","last_undegraded":"2023-08-09T14:16:28.477610+0000","last_fullsized":"2023-08-09T14:16:28.477610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:10.775803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635453+0000","last_change":"2023-08-09T14:16:27.369618+0000","last_active":"2023-08-09T14:16:28.635453+0000","last_peered":"2023-08-09T14:16:28.635453+0000","last_clean":"2023-08-09T14:16:28.635453+0000","last_became_active":"2023-08-09T14:16:27.369287+0000","last_became_peered":"2023-08-09T14:16:27.369287+0000","last_unstale":"2023-08-09T14:16:28.635453+0000","last_undegraded":"2023-08-09T14:16:28.635453+0000","last_fullsized":"2023-08-09T14:16:28.635453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:00:52.970600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635701+0000","last_change":"2023-08-09T14:16:27.378759+0000","last_active":"2023-08-09T14:16:28.635701+0000","last_peered":"2023-08-09T14:16:28.635701+0000","last_clean":"2023-08-09T14:16:28.635701+0000","last_became_active":"2023-08-09T14:16:27.378489+0000","last_became_peered":"2023-08-09T14:16:27.378489+0000","last_unstale":"2023-08-09T14:16:28.635701+0000","last_undegraded":"2023-08-09T14:16:28.635701+0000","last_fullsized":"2023-08-09T14:16:28.635701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:06:19.169909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635186+0000","last_change":"2023-08-09T14:16:27.384299+0000","last_active":"2023-08-09T14:16:28.635186+0000","last_peered":"2023-08-09T14:16:28.635186+0000","last_clean":"2023-08-09T14:16:28.635186+0000","last_became_active":"2023-08-09T14:16:27.383976+0000","last_became_peered":"2023-08-09T14:16:27.383976+0000","last_unstale":"2023-08-09T14:16:28.635186+0000","last_undegraded":"2023-08-09T14:16:28.635186+0000","last_fullsized":"2023-08-09T14:16:28.635186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:31.479992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635932+0000","last_change":"2023-08-09T14:16:27.371564+0000","last_active":"2023-08-09T14:16:28.635932+0000","last_peered":"2023-08-09T14:16:28.635932+0000","last_clean":"2023-08-09T14:16:28.635932+0000","last_became_active":"2023-08-09T14:16:27.371057+0000","last_became_peered":"2023-08-09T14:16:27.371057+0000","last_unstale":"2023-08-09T14:16:28.635932+0000","last_undegraded":"2023-08-09T14:16:28.635932+0000","last_fullsized":"2023-08-09T14:16:28.635932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:06:28.128390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.375963+0000","last_change":"2023-08-09T14:16:27.381355+0000","last_active":"2023-08-09T14:16:28.375963+0000","last_peered":"2023-08-09T14:16:28.375963+0000","last_clean":"2023-08-09T14:16:28.375963+0000","last_became_active":"2023-08-09T14:16:27.380358+0000","last_became_peered":"2023-08-09T14:16:27.380358+0000","last_unstale":"2023-08-09T14:16:28.375963+0000","last_undegraded":"2023-08-09T14:16:28.375963+0000","last_fullsized":"2023-08-09T14:16:28.375963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:51.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477769+0000","last_change":"2023-08-09T14:16:27.384445+0000","last_active":"2023-08-09T14:16:28.477769+0000","last_peered":"2023-08-09T14:16:28.477769+0000","last_clean":"2023-08-09T14:16:28.477769+0000","last_became_active":"2023-08-09T14:16:27.384036+0000","last_became_peered":"2023-08-09T14:16:27.384036+0000","last_unstale":"2023-08-09T14:16:28.477769+0000","last_undegraded":"2023-08-09T14:16:28.477769+0000","last_fullsized":"2023-08-09T14:16:28.477769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:06:28.128390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635820+0000","last_change":"2023-08-09T14:16:27.375005+0000","last_active":"2023-08-09T14:16:28.635820+0000","last_peered":"2023-08-09T14:16:28.635820+0000","last_clean":"2023-08-09T14:16:28.635820+0000","last_became_active":"2023-08-09T14:16:27.374741+0000","last_became_peered":"2023-08-09T14:16:27.374741+0000","last_unstale":"2023-08-09T14:16:28.635820+0000","last_undegraded":"2023-08-09T14:16:28.635820+0000","last_fullsized":"2023-08-09T14:16:28.635820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:31:25.376065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635512+0000","last_change":"2023-08-09T14:16:27.378404+0000","last_active":"2023-08-09T14:16:28.635512+0000","last_peered":"2023-08-09T14:16:28.635512+0000","last_clean":"2023-08-09T14:16:28.635512+0000","last_became_active":"2023-08-09T14:16:27.378127+0000","last_became_peered":"2023-08-09T14:16:27.378127+0000","last_unstale":"2023-08-09T14:16:28.635512+0000","last_undegraded":"2023-08-09T14:16:28.635512+0000","last_fullsized":"2023-08-09T14:16:28.635512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:46.068900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477833+0000","last_change":"2023-08-09T14:16:27.383615+0000","last_active":"2023-08-09T14:16:28.477833+0000","last_peered":"2023-08-09T14:16:28.477833+0000","last_clean":"2023-08-09T14:16:28.477833+0000","last_became_active":"2023-08-09T14:16:27.383312+0000","last_became_peered":"2023-08-09T14:16:27.383312+0000","last_unstale":"2023-08-09T14:16:28.477833+0000","last_undegraded":"2023-08-09T14:16:28.477833+0000","last_fullsized":"2023-08-09T14:16:28.477833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:11:06.598919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635286+0000","last_change":"2023-08-09T14:16:27.376171+0000","last_active":"2023-08-09T14:16:28.635286+0000","last_peered":"2023-08-09T14:16:28.635286+0000","last_clean":"2023-08-09T14:16:28.635286+0000","last_became_active":"2023-08-09T14:16:27.375667+0000","last_became_peered":"2023-08-09T14:16:27.375667+0000","last_unstale":"2023-08-09T14:16:28.635286+0000","last_undegraded":"2023-08-09T14:16:28.635286+0000","last_fullsized":"2023-08-09T14:16:28.635286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:49:13.196026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.636047+0000","last_change":"2023-08-09T14:16:27.377543+0000","last_active":"2023-08-09T14:16:28.636047+0000","last_peered":"2023-08-09T14:16:28.636047+0000","last_clean":"2023-08-09T14:16:28.636047+0000","last_became_active":"2023-08-09T14:16:27.376670+0000","last_became_peered":"2023-08-09T14:16:27.376670+0000","last_unstale":"2023-08-09T14:16:28.636047+0000","last_undegraded":"2023-08-09T14:16:28.636047+0000","last_fullsized":"2023-08-09T14:16:28.636047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:48:35.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634930+0000","last_change":"2023-08-09T14:16:27.369086+0000","last_active":"2023-08-09T14:16:28.634930+0000","last_peered":"2023-08-09T14:16:28.634930+0000","last_clean":"2023-08-09T14:16:28.634930+0000","last_became_active":"2023-08-09T14:16:27.368821+0000","last_became_peered":"2023-08-09T14:16:27.368821+0000","last_unstale":"2023-08-09T14:16:28.634930+0000","last_undegraded":"2023-08-09T14:16:28.634930+0000","last_fullsized":"2023-08-09T14:16:28.634930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:37.553714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378241+0000","last_change":"2023-08-09T14:16:27.378467+0000","last_active":"2023-08-09T14:16:28.378241+0000","last_peered":"2023-08-09T14:16:28.378241+0000","last_clean":"2023-08-09T14:16:28.378241+0000","last_became_active":"2023-08-09T14:16:27.378209+0000","last_became_peered":"2023-08-09T14:16:27.378209+0000","last_unstale":"2023-08-09T14:16:28.378241+0000","last_undegraded":"2023-08-09T14:16:28.378241+0000","last_fullsized":"2023-08-09T14:16:28.378241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:59.049900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378492+0000","last_change":"2023-08-09T14:16:27.382940+0000","last_active":"2023-08-09T14:16:28.378492+0000","last_peered":"2023-08-09T14:16:28.378492+0000","last_clean":"2023-08-09T14:16:28.378492+0000","last_became_active":"2023-08-09T14:16:27.382676+0000","last_became_peered":"2023-08-09T14:16:27.382676+0000","last_unstale":"2023-08-09T14:16:28.378492+0000","last_undegraded":"2023-08-09T14:16:28.378492+0000","last_fullsized":"2023-08-09T14:16:28.378492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:03.077867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379541+0000","last_change":"2023-08-09T14:16:27.382323+0000","last_active":"2023-08-09T14:16:28.379541+0000","last_peered":"2023-08-09T14:16:28.379541+0000","last_clean":"2023-08-09T14:16:28.379541+0000","last_became_active":"2023-08-09T14:16:27.382004+0000","last_became_peered":"2023-08-09T14:16:27.382004+0000","last_unstale":"2023-08-09T14:16:28.379541+0000","last_undegraded":"2023-08-09T14:16:28.379541+0000","last_fullsized":"2023-08-09T14:16:28.379541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:16.454714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635270+0000","last_change":"2023-08-09T14:16:27.380065+0000","last_active":"2023-08-09T14:16:28.635270+0000","last_peered":"2023-08-09T14:16:28.635270+0000","last_clean":"2023-08-09T14:16:28.635270+0000","last_became_active":"2023-08-09T14:16:27.379799+0000","last_became_peered":"2023-08-09T14:16:27.379799+0000","last_unstale":"2023-08-09T14:16:28.635270+0000","last_undegraded":"2023-08-09T14:16:28.635270+0000","last_fullsized":"2023-08-09T14:16:28.635270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T02:07:43.837022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379437+0000","last_change":"2023-08-09T14:16:27.382542+0000","last_active":"2023-08-09T14:16:28.379437+0000","last_peered":"2023-08-09T14:16:28.379437+0000","last_clean":"2023-08-09T14:16:28.379437+0000","last_became_active":"2023-08-09T14:16:27.381797+0000","last_became_peered":"2023-08-09T14:16:27.381797+0000","last_unstale":"2023-08-09T14:16:28.379437+0000","last_undegraded":"2023-08-09T14:16:28.379437+0000","last_fullsized":"2023-08-09T14:16:28.379437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:11.552701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635601+0000","last_change":"2023-08-09T14:16:27.381512+0000","last_active":"2023-08-09T14:16:28.635601+0000","last_peered":"2023-08-09T14:16:28.635601+0000","last_clean":"2023-08-09T14:16:28.635601+0000","last_became_active":"2023-08-09T14:16:27.380142+0000","last_became_peered":"2023-08-09T14:16:27.380142+0000","last_unstale":"2023-08-09T14:16:28.635601+0000","last_undegraded":"2023-08-09T14:16:28.635601+0000","last_fullsized":"2023-08-09T14:16:28.635601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:10.775803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635113+0000","last_change":"2023-08-09T14:16:27.377741+0000","last_active":"2023-08-09T14:16:28.635113+0000","last_peered":"2023-08-09T14:16:28.635113+0000","last_clean":"2023-08-09T14:16:28.635113+0000","last_became_active":"2023-08-09T14:16:27.377033+0000","last_became_peered":"2023-08-09T14:16:27.377033+0000","last_unstale":"2023-08-09T14:16:28.635113+0000","last_undegraded":"2023-08-09T14:16:28.635113+0000","last_fullsized":"2023-08-09T14:16:28.635113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:16.103851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378951+0000","last_change":"2023-08-09T14:16:27.383386+0000","last_active":"2023-08-09T14:16:28.378951+0000","last_peered":"2023-08-09T14:16:28.378951+0000","last_clean":"2023-08-09T14:16:28.378951+0000","last_became_active":"2023-08-09T14:16:27.383106+0000","last_became_peered":"2023-08-09T14:16:27.383106+0000","last_unstale":"2023-08-09T14:16:28.378951+0000","last_undegraded":"2023-08-09T14:16:28.378951+0000","last_fullsized":"2023-08-09T14:16:28.378951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:58.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635016+0000","last_change":"2023-08-09T14:16:27.379467+0000","last_active":"2023-08-09T14:16:28.635016+0000","last_peered":"2023-08-09T14:16:28.635016+0000","last_clean":"2023-08-09T14:16:28.635016+0000","last_became_active":"2023-08-09T14:16:27.378151+0000","last_became_peered":"2023-08-09T14:16:27.378151+0000","last_unstale":"2023-08-09T14:16:28.635016+0000","last_undegraded":"2023-08-09T14:16:28.635016+0000","last_fullsized":"2023-08-09T14:16:28.635016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:02:52.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379690+0000","last_change":"2023-08-09T14:16:27.385943+0000","last_active":"2023-08-09T14:16:28.379690+0000","last_peered":"2023-08-09T14:16:28.379690+0000","last_clean":"2023-08-09T14:16:28.379690+0000","last_became_active":"2023-08-09T14:16:27.385691+0000","last_became_peered":"2023-08-09T14:16:27.385691+0000","last_unstale":"2023-08-09T14:16:28.379690+0000","last_undegraded":"2023-08-09T14:16:28.379690+0000","last_fullsized":"2023-08-09T14:16:28.379690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:24:53.297067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635145+0000","last_change":"2023-08-09T14:16:27.381598+0000","last_active":"2023-08-09T14:16:28.635145+0000","last_peered":"2023-08-09T14:16:28.635145+0000","last_clean":"2023-08-09T14:16:28.635145+0000","last_became_active":"2023-08-09T14:16:27.380971+0000","last_became_peered":"2023-08-09T14:16:27.380971+0000","last_unstale":"2023-08-09T14:16:28.635145+0000","last_undegraded":"2023-08-09T14:16:28.635145+0000","last_fullsized":"2023-08-09T14:16:28.635145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:24:53.297067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379709+0000","last_change":"2023-08-09T14:16:27.372655+0000","last_active":"2023-08-09T14:16:28.379709+0000","last_peered":"2023-08-09T14:16:28.379709+0000","last_clean":"2023-08-09T14:16:28.379709+0000","last_became_active":"2023-08-09T14:16:27.372387+0000","last_became_peered":"2023-08-09T14:16:27.372387+0000","last_unstale":"2023-08-09T14:16:28.379709+0000","last_undegraded":"2023-08-09T14:16:28.379709+0000","last_fullsized":"2023-08-09T14:16:28.379709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:31.479992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635672+0000","last_change":"2023-08-09T14:16:27.371427+0000","last_active":"2023-08-09T14:16:28.635672+0000","last_peered":"2023-08-09T14:16:28.635672+0000","last_clean":"2023-08-09T14:16:28.635672+0000","last_became_active":"2023-08-09T14:16:27.371180+0000","last_became_peered":"2023-08-09T14:16:27.371180+0000","last_unstale":"2023-08-09T14:16:28.635672+0000","last_undegraded":"2023-08-09T14:16:28.635672+0000","last_fullsized":"2023-08-09T14:16:28.635672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:29.382805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378171+0000","last_change":"2023-08-09T14:16:27.382262+0000","last_active":"2023-08-09T14:16:28.378171+0000","last_peered":"2023-08-09T14:16:28.378171+0000","last_clean":"2023-08-09T14:16:28.378171+0000","last_became_active":"2023-08-09T14:16:27.381855+0000","last_became_peered":"2023-08-09T14:16:27.381855+0000","last_unstale":"2023-08-09T14:16:28.378171+0000","last_undegraded":"2023-08-09T14:16:28.378171+0000","last_fullsized":"2023-08-09T14:16:28.378171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:13:30.436533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.377917+0000","last_change":"2023-08-09T14:16:27.385174+0000","last_active":"2023-08-09T14:16:28.377917+0000","last_peered":"2023-08-09T14:16:28.377917+0000","last_clean":"2023-08-09T14:16:28.377917+0000","last_became_active":"2023-08-09T14:16:27.384888+0000","last_became_peered":"2023-08-09T14:16:27.384888+0000","last_unstale":"2023-08-09T14:16:28.377917+0000","last_undegraded":"2023-08-09T14:16:28.377917+0000","last_fullsized":"2023-08-09T14:16:28.377917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:02:55.488477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378769+0000","last_change":"2023-08-09T14:16:27.380374+0000","last_active":"2023-08-09T14:16:28.378769+0000","last_peered":"2023-08-09T14:16:28.378769+0000","last_clean":"2023-08-09T14:16:28.378769+0000","last_became_active":"2023-08-09T14:16:27.380104+0000","last_became_peered":"2023-08-09T14:16:27.380104+0000","last_unstale":"2023-08-09T14:16:28.378769+0000","last_undegraded":"2023-08-09T14:16:28.378769+0000","last_fullsized":"2023-08-09T14:16:28.378769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:56.739317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634703+0000","last_change":"2023-08-09T14:16:27.374314+0000","last_active":"2023-08-09T14:16:28.634703+0000","last_peered":"2023-08-09T14:16:28.634703+0000","last_clean":"2023-08-09T14:16:28.634703+0000","last_became_active":"2023-08-09T14:16:27.372540+0000","last_became_peered":"2023-08-09T14:16:27.372540+0000","last_unstale":"2023-08-09T14:16:28.634703+0000","last_undegraded":"2023-08-09T14:16:28.634703+0000","last_fullsized":"2023-08-09T14:16:28.634703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:32.498787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378668+0000","last_change":"2023-08-09T14:16:27.384513+0000","last_active":"2023-08-09T14:16:28.378668+0000","last_peered":"2023-08-09T14:16:28.378668+0000","last_clean":"2023-08-09T14:16:28.378668+0000","last_became_active":"2023-08-09T14:16:27.384181+0000","last_became_peered":"2023-08-09T14:16:27.384181+0000","last_unstale":"2023-08-09T14:16:28.378668+0000","last_undegraded":"2023-08-09T14:16:28.378668+0000","last_fullsized":"2023-08-09T14:16:28.378668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:55.924848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379632+0000","last_change":"2023-08-09T14:16:26.379480+0000","last_active":"2023-08-09T14:16:28.379632+0000","last_peered":"2023-08-09T14:16:28.379632+0000","last_clean":"2023-08-09T14:16:28.379632+0000","last_became_active":"2023-08-09T14:16:26.379172+0000","last_became_peered":"2023-08-09T14:16:26.379172+0000","last_unstale":"2023-08-09T14:16:28.379632+0000","last_undegraded":"2023-08-09T14:16:28.379632+0000","last_fullsized":"2023-08-09T14:16:28.379632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:19.612548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635445+0000","last_change":"2023-08-09T14:16:27.388580+0000","last_active":"2023-08-09T14:16:28.635445+0000","last_peered":"2023-08-09T14:16:28.635445+0000","last_clean":"2023-08-09T14:16:28.635445+0000","last_became_active":"2023-08-09T14:16:27.388267+0000","last_became_peered":"2023-08-09T14:16:27.388267+0000","last_unstale":"2023-08-09T14:16:28.635445+0000","last_undegraded":"2023-08-09T14:16:28.635445+0000","last_fullsized":"2023-08-09T14:16:28.635445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:10:45.851712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477855+0000","last_change":"2023-08-09T14:16:26.375491+0000","last_active":"2023-08-09T14:16:28.477855+0000","last_peered":"2023-08-09T14:16:28.477855+0000","last_clean":"2023-08-09T14:16:28.477855+0000","last_became_active":"2023-08-09T14:16:26.375132+0000","last_became_peered":"2023-08-09T14:16:26.375132+0000","last_unstale":"2023-08-09T14:16:28.477855+0000","last_undegraded":"2023-08-09T14:16:28.477855+0000","last_fullsized":"2023-08-09T14:16:28.477855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:50.550366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635714+0000","last_change":"2023-08-09T14:16:27.374537+0000","last_active":"2023-08-09T14:16:28.635714+0000","last_peered":"2023-08-09T14:16:28.635714+0000","last_clean":"2023-08-09T14:16:28.635714+0000","last_became_active":"2023-08-09T14:16:27.374231+0000","last_became_peered":"2023-08-09T14:16:27.374231+0000","last_unstale":"2023-08-09T14:16:28.635714+0000","last_undegraded":"2023-08-09T14:16:28.635714+0000","last_fullsized":"2023-08-09T14:16:28.635714+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:36:03.954278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635521+0000","last_change":"2023-08-09T14:16:26.373918+0000","last_active":"2023-08-09T14:16:28.635521+0000","last_peered":"2023-08-09T14:16:28.635521+0000","last_clean":"2023-08-09T14:16:28.635521+0000","last_became_active":"2023-08-09T14:16:26.373603+0000","last_became_peered":"2023-08-09T14:16:26.373603+0000","last_unstale":"2023-08-09T14:16:28.635521+0000","last_undegraded":"2023-08-09T14:16:28.635521+0000","last_fullsized":"2023-08-09T14:16:28.635521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:54.912864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376415+0000","last_change":"2023-08-09T14:16:27.385932+0000","last_active":"2023-08-09T14:16:28.376415+0000","last_peered":"2023-08-09T14:16:28.376415+0000","last_clean":"2023-08-09T14:16:28.376415+0000","last_became_active":"2023-08-09T14:16:27.385647+0000","last_became_peered":"2023-08-09T14:16:27.385647+0000","last_unstale":"2023-08-09T14:16:28.376415+0000","last_undegraded":"2023-08-09T14:16:28.376415+0000","last_fullsized":"2023-08-09T14:16:28.376415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:08.395065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635287+0000","last_change":"2023-08-09T14:16:26.374761+0000","last_active":"2023-08-09T14:16:28.635287+0000","last_peered":"2023-08-09T14:16:28.635287+0000","last_clean":"2023-08-09T14:16:28.635287+0000","last_became_active":"2023-08-09T14:16:26.374314+0000","last_became_peered":"2023-08-09T14:16:26.374314+0000","last_unstale":"2023-08-09T14:16:28.635287+0000","last_undegraded":"2023-08-09T14:16:28.635287+0000","last_fullsized":"2023-08-09T14:16:28.635287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:41:05.703836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477444+0000","last_change":"2023-08-09T14:16:27.379559+0000","last_active":"2023-08-09T14:16:28.477444+0000","last_peered":"2023-08-09T14:16:28.477444+0000","last_clean":"2023-08-09T14:16:28.477444+0000","last_became_active":"2023-08-09T14:16:27.379094+0000","last_became_peered":"2023-08-09T14:16:27.379094+0000","last_unstale":"2023-08-09T14:16:28.477444+0000","last_undegraded":"2023-08-09T14:16:28.477444+0000","last_fullsized":"2023-08-09T14:16:28.477444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:46:07.290988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635475+0000","last_change":"2023-08-09T14:16:26.376139+0000","last_active":"2023-08-09T14:16:28.635475+0000","last_peered":"2023-08-09T14:16:28.635475+0000","last_clean":"2023-08-09T14:16:28.635475+0000","last_became_active":"2023-08-09T14:16:26.375821+0000","last_became_peered":"2023-08-09T14:16:26.375821+0000","last_unstale":"2023-08-09T14:16:28.635475+0000","last_undegraded":"2023-08-09T14:16:28.635475+0000","last_fullsized":"2023-08-09T14:16:28.635475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:29:15.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.636085+0000","last_change":"2023-08-09T14:16:27.381092+0000","last_active":"2023-08-09T14:16:28.636085+0000","last_peered":"2023-08-09T14:16:28.636085+0000","last_clean":"2023-08-09T14:16:28.636085+0000","last_became_active":"2023-08-09T14:16:27.380833+0000","last_became_peered":"2023-08-09T14:16:27.380833+0000","last_unstale":"2023-08-09T14:16:28.636085+0000","last_undegraded":"2023-08-09T14:16:28.636085+0000","last_fullsized":"2023-08-09T14:16:28.636085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:12.137580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378879+0000","last_change":"2023-08-09T14:16:26.379636+0000","last_active":"2023-08-09T14:16:28.378879+0000","last_peered":"2023-08-09T14:16:28.378879+0000","last_clean":"2023-08-09T14:16:28.378879+0000","last_became_active":"2023-08-09T14:16:26.379318+0000","last_became_peered":"2023-08-09T14:16:26.379318+0000","last_unstale":"2023-08-09T14:16:28.378879+0000","last_undegraded":"2023-08-09T14:16:28.378879+0000","last_fullsized":"2023-08-09T14:16:28.378879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:31.116697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635668+0000","last_change":"2023-08-09T14:16:27.383554+0000","last_active":"2023-08-09T14:16:28.635668+0000","last_peered":"2023-08-09T14:16:28.635668+0000","last_clean":"2023-08-09T14:16:28.635668+0000","last_became_active":"2023-08-09T14:16:27.383292+0000","last_became_peered":"2023-08-09T14:16:27.383292+0000","last_unstale":"2023-08-09T14:16:28.635668+0000","last_undegraded":"2023-08-09T14:16:28.635668+0000","last_fullsized":"2023-08-09T14:16:28.635668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:19.881601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634801+0000","last_change":"2023-08-09T14:16:26.371871+0000","last_active":"2023-08-09T14:16:28.634801+0000","last_peered":"2023-08-09T14:16:28.634801+0000","last_clean":"2023-08-09T14:16:28.634801+0000","last_became_active":"2023-08-09T14:16:26.371539+0000","last_became_peered":"2023-08-09T14:16:26.371539+0000","last_unstale":"2023-08-09T14:16:28.634801+0000","last_undegraded":"2023-08-09T14:16:28.634801+0000","last_fullsized":"2023-08-09T14:16:28.634801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:10.548088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376380+0000","last_change":"2023-08-09T14:16:27.383425+0000","last_active":"2023-08-09T14:16:28.376380+0000","last_peered":"2023-08-09T14:16:28.376380+0000","last_clean":"2023-08-09T14:16:28.376380+0000","last_became_active":"2023-08-09T14:16:27.383146+0000","last_became_peered":"2023-08-09T14:16:27.383146+0000","last_unstale":"2023-08-09T14:16:28.376380+0000","last_undegraded":"2023-08-09T14:16:28.376380+0000","last_fullsized":"2023-08-09T14:16:28.376380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:18.288359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635006+0000","last_change":"2023-08-09T14:16:26.373693+0000","last_active":"2023-08-09T14:16:28.635006+0000","last_peered":"2023-08-09T14:16:28.635006+0000","last_clean":"2023-08-09T14:16:28.635006+0000","last_became_active":"2023-08-09T14:16:26.373373+0000","last_became_peered":"2023-08-09T14:16:26.373373+0000","last_unstale":"2023-08-09T14:16:28.635006+0000","last_undegraded":"2023-08-09T14:16:28.635006+0000","last_fullsized":"2023-08-09T14:16:28.635006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:24.860457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635581+0000","last_change":"2023-08-09T14:16:27.379205+0000","last_active":"2023-08-09T14:16:28.635581+0000","last_peered":"2023-08-09T14:16:28.635581+0000","last_clean":"2023-08-09T14:16:28.635581+0000","last_became_active":"2023-08-09T14:16:27.378938+0000","last_became_peered":"2023-08-09T14:16:27.378938+0000","last_unstale":"2023-08-09T14:16:28.635581+0000","last_undegraded":"2023-08-09T14:16:28.635581+0000","last_fullsized":"2023-08-09T14:16:28.635581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:02:57.239781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376430+0000","last_change":"2023-08-09T14:16:26.368660+0000","last_active":"2023-08-09T14:16:28.376430+0000","last_peered":"2023-08-09T14:16:28.376430+0000","last_clean":"2023-08-09T14:16:28.376430+0000","last_became_active":"2023-08-09T14:16:26.368331+0000","last_became_peered":"2023-08-09T14:16:26.368331+0000","last_unstale":"2023-08-09T14:16:28.376430+0000","last_undegraded":"2023-08-09T14:16:28.376430+0000","last_fullsized":"2023-08-09T14:16:28.376430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:27:11.429564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378574+0000","last_change":"2023-08-09T14:16:27.377384+0000","last_active":"2023-08-09T14:16:28.378574+0000","last_peered":"2023-08-09T14:16:28.378574+0000","last_clean":"2023-08-09T14:16:28.378574+0000","last_became_active":"2023-08-09T14:16:27.377112+0000","last_became_peered":"2023-08-09T14:16:27.377112+0000","last_unstale":"2023-08-09T14:16:28.378574+0000","last_undegraded":"2023-08-09T14:16:28.378574+0000","last_fullsized":"2023-08-09T14:16:28.378574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:07:33.983649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635969+0000","last_change":"2023-08-09T14:16:26.368580+0000","last_active":"2023-08-09T14:16:28.635969+0000","last_peered":"2023-08-09T14:16:28.635969+0000","last_clean":"2023-08-09T14:16:28.635969+0000","last_became_active":"2023-08-09T14:16:26.368333+0000","last_became_peered":"2023-08-09T14:16:26.368333+0000","last_unstale":"2023-08-09T14:16:28.635969+0000","last_undegraded":"2023-08-09T14:16:28.635969+0000","last_fullsized":"2023-08-09T14:16:28.635969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:11:05.594306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477772+0000","last_change":"2023-08-09T14:16:27.392373+0000","last_active":"2023-08-09T14:16:28.477772+0000","last_peered":"2023-08-09T14:16:28.477772+0000","last_clean":"2023-08-09T14:16:28.477772+0000","last_became_active":"2023-08-09T14:16:27.392049+0000","last_became_peered":"2023-08-09T14:16:27.392049+0000","last_unstale":"2023-08-09T14:16:28.477772+0000","last_undegraded":"2023-08-09T14:16:28.477772+0000","last_fullsized":"2023-08-09T14:16:28.477772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:01:16.518575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635643+0000","last_change":"2023-08-09T14:16:26.364086+0000","last_active":"2023-08-09T14:16:28.635643+0000","last_peered":"2023-08-09T14:16:28.635643+0000","last_clean":"2023-08-09T14:16:28.635643+0000","last_became_active":"2023-08-09T14:16:26.363616+0000","last_became_peered":"2023-08-09T14:16:26.363616+0000","last_unstale":"2023-08-09T14:16:28.635643+0000","last_undegraded":"2023-08-09T14:16:28.635643+0000","last_fullsized":"2023-08-09T14:16:28.635643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:11.369310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635480+0000","last_change":"2023-08-09T14:16:27.369363+0000","last_active":"2023-08-09T14:16:28.635480+0000","last_peered":"2023-08-09T14:16:28.635480+0000","last_clean":"2023-08-09T14:16:28.635480+0000","last_became_active":"2023-08-09T14:16:27.369094+0000","last_became_peered":"2023-08-09T14:16:27.369094+0000","last_unstale":"2023-08-09T14:16:28.635480+0000","last_undegraded":"2023-08-09T14:16:28.635480+0000","last_fullsized":"2023-08-09T14:16:28.635480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:13:58.150927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376373+0000","last_change":"2023-08-09T14:16:26.372916+0000","last_active":"2023-08-09T14:16:28.376373+0000","last_peered":"2023-08-09T14:16:28.376373+0000","last_clean":"2023-08-09T14:16:28.376373+0000","last_became_active":"2023-08-09T14:16:26.372596+0000","last_became_peered":"2023-08-09T14:16:26.372596+0000","last_unstale":"2023-08-09T14:16:28.376373+0000","last_undegraded":"2023-08-09T14:16:28.376373+0000","last_fullsized":"2023-08-09T14:16:28.376373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:28.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477606+0000","last_change":"2023-08-09T14:16:27.382774+0000","last_active":"2023-08-09T14:16:28.477606+0000","last_peered":"2023-08-09T14:16:28.477606+0000","last_clean":"2023-08-09T14:16:28.477606+0000","last_became_active":"2023-08-09T14:16:27.379469+0000","last_became_peered":"2023-08-09T14:16:27.379469+0000","last_unstale":"2023-08-09T14:16:28.477606+0000","last_undegraded":"2023-08-09T14:16:28.477606+0000","last_fullsized":"2023-08-09T14:16:28.477606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:12.373924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376543+0000","last_change":"2023-08-09T14:16:26.376657+0000","last_active":"2023-08-09T14:16:28.376543+0000","last_peered":"2023-08-09T14:16:28.376543+0000","last_clean":"2023-08-09T14:16:28.376543+0000","last_became_active":"2023-08-09T14:16:26.376314+0000","last_became_peered":"2023-08-09T14:16:26.376314+0000","last_unstale":"2023-08-09T14:16:28.376543+0000","last_undegraded":"2023-08-09T14:16:28.376543+0000","last_fullsized":"2023-08-09T14:16:28.376543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:06:34.339530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376324+0000","last_change":"2023-08-09T14:16:27.392552+0000","last_active":"2023-08-09T14:16:28.376324+0000","last_peered":"2023-08-09T14:16:28.376324+0000","last_clean":"2023-08-09T14:16:28.376324+0000","last_became_active":"2023-08-09T14:16:27.392251+0000","last_became_peered":"2023-08-09T14:16:27.392251+0000","last_unstale":"2023-08-09T14:16:28.376324+0000","last_undegraded":"2023-08-09T14:16:28.376324+0000","last_fullsized":"2023-08-09T14:16:28.376324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:40.643634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635317+0000","last_change":"2023-08-09T14:16:26.372527+0000","last_active":"2023-08-09T14:16:28.635317+0000","last_peered":"2023-08-09T14:16:28.635317+0000","last_clean":"2023-08-09T14:16:28.635317+0000","last_became_active":"2023-08-09T14:16:26.371439+0000","last_became_peered":"2023-08-09T14:16:26.371439+0000","last_unstale":"2023-08-09T14:16:28.635317+0000","last_undegraded":"2023-08-09T14:16:28.635317+0000","last_fullsized":"2023-08-09T14:16:28.635317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:46:00.799478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378373+0000","last_change":"2023-08-09T14:16:27.383836+0000","last_active":"2023-08-09T14:16:28.378373+0000","last_peered":"2023-08-09T14:16:28.378373+0000","last_clean":"2023-08-09T14:16:28.378373+0000","last_became_active":"2023-08-09T14:16:27.383635+0000","last_became_peered":"2023-08-09T14:16:27.383635+0000","last_unstale":"2023-08-09T14:16:28.378373+0000","last_undegraded":"2023-08-09T14:16:28.378373+0000","last_fullsized":"2023-08-09T14:16:28.378373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:00:54.847828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.377723+0000","last_change":"2023-08-09T14:16:26.377125+0000","last_active":"2023-08-09T14:16:28.377723+0000","last_peered":"2023-08-09T14:16:28.377723+0000","last_clean":"2023-08-09T14:16:28.377723+0000","last_became_active":"2023-08-09T14:16:26.376798+0000","last_became_peered":"2023-08-09T14:16:26.376798+0000","last_unstale":"2023-08-09T14:16:28.377723+0000","last_undegraded":"2023-08-09T14:16:28.377723+0000","last_fullsized":"2023-08-09T14:16:28.377723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:33:14.889624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376365+0000","last_change":"2023-08-09T14:16:27.393209+0000","last_active":"2023-08-09T14:16:28.376365+0000","last_peered":"2023-08-09T14:16:28.376365+0000","last_clean":"2023-08-09T14:16:28.376365+0000","last_became_active":"2023-08-09T14:16:27.391935+0000","last_became_peered":"2023-08-09T14:16:27.391935+0000","last_unstale":"2023-08-09T14:16:28.376365+0000","last_undegraded":"2023-08-09T14:16:28.376365+0000","last_fullsized":"2023-08-09T14:16:28.376365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:34.278389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378382+0000","last_change":"2023-08-09T14:16:26.375153+0000","last_active":"2023-08-09T14:16:28.378382+0000","last_peered":"2023-08-09T14:16:28.378382+0000","last_clean":"2023-08-09T14:16:28.378382+0000","last_became_active":"2023-08-09T14:16:26.374863+0000","last_became_peered":"2023-08-09T14:16:26.374863+0000","last_unstale":"2023-08-09T14:16:28.378382+0000","last_undegraded":"2023-08-09T14:16:28.378382+0000","last_fullsized":"2023-08-09T14:16:28.378382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:34:46.131017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376213+0000","last_change":"2023-08-09T14:16:27.382903+0000","last_active":"2023-08-09T14:16:28.376213+0000","last_peered":"2023-08-09T14:16:28.376213+0000","last_clean":"2023-08-09T14:16:28.376213+0000","last_became_active":"2023-08-09T14:16:27.382532+0000","last_became_peered":"2023-08-09T14:16:27.382532+0000","last_unstale":"2023-08-09T14:16:28.376213+0000","last_undegraded":"2023-08-09T14:16:28.376213+0000","last_fullsized":"2023-08-09T14:16:28.376213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:44.119989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635982+0000","last_change":"2023-08-09T14:16:26.373465+0000","last_active":"2023-08-09T14:16:28.635982+0000","last_peered":"2023-08-09T14:16:28.635982+0000","last_clean":"2023-08-09T14:16:28.635982+0000","last_became_active":"2023-08-09T14:16:26.373174+0000","last_became_peered":"2023-08-09T14:16:26.373174+0000","last_unstale":"2023-08-09T14:16:28.635982+0000","last_undegraded":"2023-08-09T14:16:28.635982+0000","last_fullsized":"2023-08-09T14:16:28.635982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:50.550366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635991+0000","last_change":"2023-08-09T14:16:27.382790+0000","last_active":"2023-08-09T14:16:28.635991+0000","last_peered":"2023-08-09T14:16:28.635991+0000","last_clean":"2023-08-09T14:16:28.635991+0000","last_became_active":"2023-08-09T14:16:27.380735+0000","last_became_peered":"2023-08-09T14:16:27.380735+0000","last_unstale":"2023-08-09T14:16:28.635991+0000","last_undegraded":"2023-08-09T14:16:28.635991+0000","last_fullsized":"2023-08-09T14:16:28.635991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:06.202277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.636035+0000","last_change":"2023-08-09T14:16:26.374493+0000","last_active":"2023-08-09T14:16:28.636035+0000","last_peered":"2023-08-09T14:16:28.636035+0000","last_clean":"2023-08-09T14:16:28.636035+0000","last_became_active":"2023-08-09T14:16:26.374219+0000","last_became_peered":"2023-08-09T14:16:26.374219+0000","last_unstale":"2023-08-09T14:16:28.636035+0000","last_undegraded":"2023-08-09T14:16:28.636035+0000","last_fullsized":"2023-08-09T14:16:28.636035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:00:35.651556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635860+0000","last_change":"2023-08-09T14:16:27.381375+0000","last_active":"2023-08-09T14:16:28.635860+0000","last_peered":"2023-08-09T14:16:28.635860+0000","last_clean":"2023-08-09T14:16:28.635860+0000","last_became_active":"2023-08-09T14:16:27.379707+0000","last_became_peered":"2023-08-09T14:16:27.379707+0000","last_unstale":"2023-08-09T14:16:28.635860+0000","last_undegraded":"2023-08-09T14:16:28.635860+0000","last_fullsized":"2023-08-09T14:16:28.635860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:13:11.099754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635435+0000","last_change":"2023-08-09T14:16:26.372562+0000","last_active":"2023-08-09T14:16:28.635435+0000","last_peered":"2023-08-09T14:16:28.635435+0000","last_clean":"2023-08-09T14:16:28.635435+0000","last_became_active":"2023-08-09T14:16:26.372128+0000","last_became_peered":"2023-08-09T14:16:26.372128+0000","last_unstale":"2023-08-09T14:16:28.635435+0000","last_undegraded":"2023-08-09T14:16:28.635435+0000","last_fullsized":"2023-08-09T14:16:28.635435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:40.775094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635289+0000","last_change":"2023-08-09T14:16:27.374486+0000","last_active":"2023-08-09T14:16:28.635289+0000","last_peered":"2023-08-09T14:16:28.635289+0000","last_clean":"2023-08-09T14:16:28.635289+0000","last_became_active":"2023-08-09T14:16:27.374178+0000","last_became_peered":"2023-08-09T14:16:27.374178+0000","last_unstale":"2023-08-09T14:16:28.635289+0000","last_undegraded":"2023-08-09T14:16:28.635289+0000","last_fullsized":"2023-08-09T14:16:28.635289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:37.463455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635128+0000","last_change":"2023-08-09T14:16:26.374002+0000","last_active":"2023-08-09T14:16:28.635128+0000","last_peered":"2023-08-09T14:16:28.635128+0000","last_clean":"2023-08-09T14:16:28.635128+0000","last_became_active":"2023-08-09T14:16:26.373657+0000","last_became_peered":"2023-08-09T14:16:26.373657+0000","last_unstale":"2023-08-09T14:16:28.635128+0000","last_undegraded":"2023-08-09T14:16:28.635128+0000","last_fullsized":"2023-08-09T14:16:28.635128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:19.612548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379016+0000","last_change":"2023-08-09T14:16:27.386594+0000","last_active":"2023-08-09T14:16:28.379016+0000","last_peered":"2023-08-09T14:16:28.379016+0000","last_clean":"2023-08-09T14:16:28.379016+0000","last_became_active":"2023-08-09T14:16:27.385405+0000","last_became_peered":"2023-08-09T14:16:27.385405+0000","last_unstale":"2023-08-09T14:16:28.379016+0000","last_undegraded":"2023-08-09T14:16:28.379016+0000","last_fullsized":"2023-08-09T14:16:28.379016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:15:57.328282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635660+0000","last_change":"2023-08-09T14:16:26.376107+0000","last_active":"2023-08-09T14:16:28.635660+0000","last_peered":"2023-08-09T14:16:28.635660+0000","last_clean":"2023-08-09T14:16:28.635660+0000","last_became_active":"2023-08-09T14:16:26.375835+0000","last_became_peered":"2023-08-09T14:16:26.375835+0000","last_unstale":"2023-08-09T14:16:28.635660+0000","last_undegraded":"2023-08-09T14:16:28.635660+0000","last_fullsized":"2023-08-09T14:16:28.635660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:50:04.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477520+0000","last_change":"2023-08-09T14:16:27.392363+0000","last_active":"2023-08-09T14:16:28.477520+0000","last_peered":"2023-08-09T14:16:28.477520+0000","last_clean":"2023-08-09T14:16:28.477520+0000","last_became_active":"2023-08-09T14:16:27.392066+0000","last_became_peered":"2023-08-09T14:16:27.392066+0000","last_unstale":"2023-08-09T14:16:28.477520+0000","last_undegraded":"2023-08-09T14:16:28.477520+0000","last_fullsized":"2023-08-09T14:16:28.477520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:29:16.219322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635132+0000","last_change":"2023-08-09T14:16:26.375485+0000","last_active":"2023-08-09T14:16:28.635132+0000","last_peered":"2023-08-09T14:16:28.635132+0000","last_clean":"2023-08-09T14:16:28.635132+0000","last_became_active":"2023-08-09T14:16:26.375182+0000","last_became_peered":"2023-08-09T14:16:26.375182+0000","last_unstale":"2023-08-09T14:16:28.635132+0000","last_undegraded":"2023-08-09T14:16:28.635132+0000","last_fullsized":"2023-08-09T14:16:28.635132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:50:35.784426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635426+0000","last_change":"2023-08-09T14:16:27.373785+0000","last_active":"2023-08-09T14:16:28.635426+0000","last_peered":"2023-08-09T14:16:28.635426+0000","last_clean":"2023-08-09T14:16:28.635426+0000","last_became_active":"2023-08-09T14:16:27.373098+0000","last_became_peered":"2023-08-09T14:16:27.373098+0000","last_unstale":"2023-08-09T14:16:28.635426+0000","last_undegraded":"2023-08-09T14:16:28.635426+0000","last_fullsized":"2023-08-09T14:16:28.635426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:46:07.290988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378972+0000","last_change":"2023-08-09T14:16:26.377424+0000","last_active":"2023-08-09T14:16:28.378972+0000","last_peered":"2023-08-09T14:16:28.378972+0000","last_clean":"2023-08-09T14:16:28.378972+0000","last_became_active":"2023-08-09T14:16:26.377107+0000","last_became_peered":"2023-08-09T14:16:26.377107+0000","last_unstale":"2023-08-09T14:16:28.378972+0000","last_undegraded":"2023-08-09T14:16:28.378972+0000","last_fullsized":"2023-08-09T14:16:28.378972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:06:06.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376182+0000","last_change":"2023-08-09T14:16:27.384099+0000","last_active":"2023-08-09T14:16:28.376182+0000","last_peered":"2023-08-09T14:16:28.376182+0000","last_clean":"2023-08-09T14:16:28.376182+0000","last_became_active":"2023-08-09T14:16:27.383700+0000","last_became_peered":"2023-08-09T14:16:27.383700+0000","last_unstale":"2023-08-09T14:16:28.376182+0000","last_undegraded":"2023-08-09T14:16:28.376182+0000","last_fullsized":"2023-08-09T14:16:28.376182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:33:14.979520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634943+0000","last_change":"2023-08-09T14:16:26.376823+0000","last_active":"2023-08-09T14:16:28.634943+0000","last_peered":"2023-08-09T14:16:28.634943+0000","last_clean":"2023-08-09T14:16:28.634943+0000","last_became_active":"2023-08-09T14:16:26.376580+0000","last_became_peered":"2023-08-09T14:16:26.376580+0000","last_unstale":"2023-08-09T14:16:28.634943+0000","last_undegraded":"2023-08-09T14:16:28.634943+0000","last_fullsized":"2023-08-09T14:16:28.634943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:50:40.937719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635813+0000","last_change":"2023-08-09T14:16:27.377295+0000","last_active":"2023-08-09T14:16:28.635813+0000","last_peered":"2023-08-09T14:16:28.635813+0000","last_clean":"2023-08-09T14:16:28.635813+0000","last_became_active":"2023-08-09T14:16:27.376324+0000","last_became_peered":"2023-08-09T14:16:27.376324+0000","last_unstale":"2023-08-09T14:16:28.635813+0000","last_undegraded":"2023-08-09T14:16:28.635813+0000","last_fullsized":"2023-08-09T14:16:28.635813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:04:07.147043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.636047+0000","last_change":"2023-08-09T14:16:26.375460+0000","last_active":"2023-08-09T14:16:28.636047+0000","last_peered":"2023-08-09T14:16:28.636047+0000","last_clean":"2023-08-09T14:16:28.636047+0000","last_became_active":"2023-08-09T14:16:26.375201+0000","last_became_peered":"2023-08-09T14:16:26.375201+0000","last_unstale":"2023-08-09T14:16:28.636047+0000","last_undegraded":"2023-08-09T14:16:28.636047+0000","last_fullsized":"2023-08-09T14:16:28.636047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:36:02.727162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635198+0000","last_change":"2023-08-09T14:15:21.530263+0000","last_active":"2023-08-09T14:16:28.635198+0000","last_peered":"2023-08-09T14:16:28.635198+0000","last_clean":"2023-08-09T14:16:28.635198+0000","last_became_active":"2023-08-09T14:15:21.529949+0000","last_became_peered":"2023-08-09T14:15:21.529949+0000","last_unstale":"2023-08-09T14:16:28.635198+0000","last_undegraded":"2023-08-09T14:16:28.635198+0000","last_fullsized":"2023-08-09T14:16:28.635198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:48:27.755665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378990+0000","last_change":"2023-08-09T14:16:27.376561+0000","last_active":"2023-08-09T14:16:28.378990+0000","last_peered":"2023-08-09T14:16:28.378990+0000","last_clean":"2023-08-09T14:16:28.378990+0000","last_became_active":"2023-08-09T14:16:27.376153+0000","last_became_peered":"2023-08-09T14:16:27.376153+0000","last_unstale":"2023-08-09T14:16:28.378990+0000","last_undegraded":"2023-08-09T14:16:28.378990+0000","last_fullsized":"2023-08-09T14:16:28.378990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:28.448641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376068+0000","last_change":"2023-08-09T14:16:26.368097+0000","last_active":"2023-08-09T14:16:28.376068+0000","last_peered":"2023-08-09T14:16:28.376068+0000","last_clean":"2023-08-09T14:16:28.376068+0000","last_became_active":"2023-08-09T14:16:26.367758+0000","last_became_peered":"2023-08-09T14:16:26.367758+0000","last_unstale":"2023-08-09T14:16:28.376068+0000","last_undegraded":"2023-08-09T14:16:28.376068+0000","last_fullsized":"2023-08-09T14:16:28.376068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:05.197664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376480+0000","last_change":"2023-08-09T14:15:21.333469+0000","last_active":"2023-08-09T14:16:28.376480+0000","last_peered":"2023-08-09T14:16:28.376480+0000","last_clean":"2023-08-09T14:16:28.376480+0000","last_became_active":"2023-08-09T14:15:21.333131+0000","last_became_peered":"2023-08-09T14:15:21.333131+0000","last_unstale":"2023-08-09T14:16:28.376480+0000","last_undegraded":"2023-08-09T14:16:28.376480+0000","last_fullsized":"2023-08-09T14:16:28.376480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:17.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635109+0000","last_change":"2023-08-09T14:16:27.384178+0000","last_active":"2023-08-09T14:16:28.635109+0000","last_peered":"2023-08-09T14:16:28.635109+0000","last_clean":"2023-08-09T14:16:28.635109+0000","last_became_active":"2023-08-09T14:16:27.381376+0000","last_became_peered":"2023-08-09T14:16:27.381376+0000","last_unstale":"2023-08-09T14:16:28.635109+0000","last_undegraded":"2023-08-09T14:16:28.635109+0000","last_fullsized":"2023-08-09T14:16:28.635109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:49:04.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.636023+0000","last_change":"2023-08-09T14:16:26.368593+0000","last_active":"2023-08-09T14:16:28.636023+0000","last_peered":"2023-08-09T14:16:28.636023+0000","last_clean":"2023-08-09T14:16:28.636023+0000","last_became_active":"2023-08-09T14:16:26.368316+0000","last_became_peered":"2023-08-09T14:16:26.368316+0000","last_unstale":"2023-08-09T14:16:28.636023+0000","last_undegraded":"2023-08-09T14:16:28.636023+0000","last_fullsized":"2023-08-09T14:16:28.636023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:39.639021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634899+0000","last_change":"2023-08-09T14:15:21.339411+0000","last_active":"2023-08-09T14:16:28.634899+0000","last_peered":"2023-08-09T14:16:28.634899+0000","last_clean":"2023-08-09T14:16:28.634899+0000","last_became_active":"2023-08-09T14:15:21.338993+0000","last_became_peered":"2023-08-09T14:15:21.338993+0000","last_unstale":"2023-08-09T14:16:28.634899+0000","last_undegraded":"2023-08-09T14:16:28.634899+0000","last_fullsized":"2023-08-09T14:16:28.634899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:10.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378715+0000","last_change":"2023-08-09T14:15:21.333339+0000","last_active":"2023-08-09T14:16:28.378715+0000","last_peered":"2023-08-09T14:16:28.378715+0000","last_clean":"2023-08-09T14:16:28.378715+0000","last_became_active":"2023-08-09T14:15:21.332398+0000","last_became_peered":"2023-08-09T14:15:21.332398+0000","last_unstale":"2023-08-09T14:16:28.378715+0000","last_undegraded":"2023-08-09T14:16:28.378715+0000","last_fullsized":"2023-08-09T14:16:28.378715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:29:35.910977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378849+0000","last_change":"2023-08-09T14:16:27.377465+0000","last_active":"2023-08-09T14:16:28.378849+0000","last_peered":"2023-08-09T14:16:28.378849+0000","last_clean":"2023-08-09T14:16:28.378849+0000","last_became_active":"2023-08-09T14:16:27.377158+0000","last_became_peered":"2023-08-09T14:16:27.377158+0000","last_unstale":"2023-08-09T14:16:28.378849+0000","last_undegraded":"2023-08-09T14:16:28.378849+0000","last_fullsized":"2023-08-09T14:16:28.378849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:11:27.476698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635310+0000","last_change":"2023-08-09T14:16:26.372469+0000","last_active":"2023-08-09T14:16:28.635310+0000","last_peered":"2023-08-09T14:16:28.635310+0000","last_clean":"2023-08-09T14:16:28.635310+0000","last_became_active":"2023-08-09T14:16:26.372109+0000","last_became_peered":"2023-08-09T14:16:26.372109+0000","last_unstale":"2023-08-09T14:16:28.635310+0000","last_undegraded":"2023-08-09T14:16:28.635310+0000","last_fullsized":"2023-08-09T14:16:28.635310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:42:33.333444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378495+0000","last_change":"2023-08-09T14:15:21.713111+0000","last_active":"2023-08-09T14:16:28.378495+0000","last_peered":"2023-08-09T14:16:28.378495+0000","last_clean":"2023-08-09T14:16:28.378495+0000","last_became_active":"2023-08-09T14:15:21.712780+0000","last_became_peered":"2023-08-09T14:15:21.712780+0000","last_unstale":"2023-08-09T14:16:28.378495+0000","last_undegraded":"2023-08-09T14:16:28.378495+0000","last_fullsized":"2023-08-09T14:16:28.378495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:00.013767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635858+0000","last_change":"2023-08-09T14:16:27.371074+0000","last_active":"2023-08-09T14:16:28.635858+0000","last_peered":"2023-08-09T14:16:28.635858+0000","last_clean":"2023-08-09T14:16:28.635858+0000","last_became_active":"2023-08-09T14:16:27.370486+0000","last_became_peered":"2023-08-09T14:16:27.370486+0000","last_unstale":"2023-08-09T14:16:28.635858+0000","last_undegraded":"2023-08-09T14:16:28.635858+0000","last_fullsized":"2023-08-09T14:16:28.635858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:01:16.518575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378690+0000","last_change":"2023-08-09T14:16:26.374316+0000","last_active":"2023-08-09T14:16:28.378690+0000","last_peered":"2023-08-09T14:16:28.378690+0000","last_clean":"2023-08-09T14:16:28.378690+0000","last_became_active":"2023-08-09T14:16:26.374052+0000","last_became_peered":"2023-08-09T14:16:26.374052+0000","last_unstale":"2023-08-09T14:16:28.378690+0000","last_undegraded":"2023-08-09T14:16:28.378690+0000","last_fullsized":"2023-08-09T14:16:28.378690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:41:52.699907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.378561+0000","last_change":"2023-08-09T14:15:21.713034+0000","last_active":"2023-08-09T14:16:28.378561+0000","last_peered":"2023-08-09T14:16:28.378561+0000","last_clean":"2023-08-09T14:16:28.378561+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:16:28.378561+0000","last_undegraded":"2023-08-09T14:16:28.378561+0000","last_fullsized":"2023-08-09T14:16:28.378561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:35:37.981080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.376212+0000","last_change":"2023-08-09T14:16:27.375603+0000","last_active":"2023-08-09T14:16:28.376212+0000","last_peered":"2023-08-09T14:16:28.376212+0000","last_clean":"2023-08-09T14:16:28.376212+0000","last_became_active":"2023-08-09T14:16:27.375251+0000","last_became_peered":"2023-08-09T14:16:27.375251+0000","last_unstale":"2023-08-09T14:16:28.376212+0000","last_undegraded":"2023-08-09T14:16:28.376212+0000","last_fullsized":"2023-08-09T14:16:28.376212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:57:30.189864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477721+0000","last_change":"2023-08-09T14:16:26.376335+0000","last_active":"2023-08-09T14:16:28.477721+0000","last_peered":"2023-08-09T14:16:28.477721+0000","last_clean":"2023-08-09T14:16:28.477721+0000","last_became_active":"2023-08-09T14:16:26.376013+0000","last_became_peered":"2023-08-09T14:16:26.376013+0000","last_unstale":"2023-08-09T14:16:28.477721+0000","last_undegraded":"2023-08-09T14:16:28.477721+0000","last_fullsized":"2023-08-09T14:16:28.477721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:31:24.371451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.635886+0000","last_change":"2023-08-09T14:15:21.713030+0000","last_active":"2023-08-09T14:16:28.635886+0000","last_peered":"2023-08-09T14:16:28.635886+0000","last_clean":"2023-08-09T14:16:28.635886+0000","last_became_active":"2023-08-09T14:15:21.712732+0000","last_became_peered":"2023-08-09T14:15:21.712732+0000","last_unstale":"2023-08-09T14:16:28.635886+0000","last_undegraded":"2023-08-09T14:16:28.635886+0000","last_fullsized":"2023-08-09T14:16:28.635886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:08.939754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.634762+0000","last_change":"2023-08-09T14:16:27.376232+0000","last_active":"2023-08-09T14:16:28.634762+0000","last_peered":"2023-08-09T14:16:28.634762+0000","last_clean":"2023-08-09T14:16:28.634762+0000","last_became_active":"2023-08-09T14:16:27.375907+0000","last_became_peered":"2023-08-09T14:16:27.375907+0000","last_unstale":"2023-08-09T14:16:28.634762+0000","last_undegraded":"2023-08-09T14:16:28.634762+0000","last_fullsized":"2023-08-09T14:16:28.634762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:13:30.436533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.377962+0000","last_change":"2023-08-09T14:16:26.376525+0000","last_active":"2023-08-09T14:16:28.377962+0000","last_peered":"2023-08-09T14:16:28.377962+0000","last_clean":"2023-08-09T14:16:28.377962+0000","last_became_active":"2023-08-09T14:16:26.376303+0000","last_became_peered":"2023-08-09T14:16:26.376303+0000","last_unstale":"2023-08-09T14:16:28.377962+0000","last_undegraded":"2023-08-09T14:16:28.377962+0000","last_fullsized":"2023-08-09T14:16:28.377962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:31.494173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379568+0000","last_change":"2023-08-09T14:15:21.713086+0000","last_active":"2023-08-09T14:16:28.379568+0000","last_peered":"2023-08-09T14:16:28.379568+0000","last_clean":"2023-08-09T14:16:28.379568+0000","last_became_active":"2023-08-09T14:15:21.712795+0000","last_became_peered":"2023-08-09T14:15:21.712795+0000","last_unstale":"2023-08-09T14:16:28.379568+0000","last_undegraded":"2023-08-09T14:16:28.379568+0000","last_fullsized":"2023-08-09T14:16:28.379568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:47:58.464050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477526+0000","last_change":"2023-08-09T14:16:27.379363+0000","last_active":"2023-08-09T14:16:28.477526+0000","last_peered":"2023-08-09T14:16:28.477526+0000","last_clean":"2023-08-09T14:16:28.477526+0000","last_became_active":"2023-08-09T14:16:27.378777+0000","last_became_peered":"2023-08-09T14:16:27.378777+0000","last_unstale":"2023-08-09T14:16:28.477526+0000","last_undegraded":"2023-08-09T14:16:28.477526+0000","last_fullsized":"2023-08-09T14:16:28.477526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:26.348008+0000","last_clean_scrub_stamp":"2023-08-09T14:16:26.348008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:46.068900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.477706+0000","last_change":"2023-08-09T14:16:26.378918+0000","last_active":"2023-08-09T14:16:28.477706+0000","last_peered":"2023-08-09T14:16:28.477706+0000","last_clean":"2023-08-09T14:16:28.477706+0000","last_became_active":"2023-08-09T14:16:26.378658+0000","last_became_peered":"2023-08-09T14:16:26.378658+0000","last_unstale":"2023-08-09T14:16:28.477706+0000","last_undegraded":"2023-08-09T14:16:28.477706+0000","last_fullsized":"2023-08-09T14:16:28.477706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:16:25.343394+0000","last_clean_scrub_stamp":"2023-08-09T14:16:25.343394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:28.378191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-09T14:16:28.379680+0000","last_change":"2023-08-09T14:15:21.339008+0000","last_active":"2023-08-09T14:16:28.379680+0000","last_peered":"2023-08-09T14:16:28.379680+0000","last_clean":"2023-08-09T14:16:28.379680+0000","last_became_active":"2023-08-09T14:15:21.338676+0000","last_became_peered":"2023-08-09T14:15:21.338676+0000","last_unstale":"2023-08-09T14:16:28.379680+0000","last_undegraded":"2023-08-09T14:16:28.379680+0000","last_fullsized":"2023-08-09T14:16:28.379680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T14:15:20.308241+0000","last_clean_scrub_stamp":"2023-08-09T14:15:20.308241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T01:44:55.764325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":158954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.55900000000000005}]},{"osd":5,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.45000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":157373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435}]},{"osd":2,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58499999999999996}]},{"osd":7,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":748830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.313}]},{"osd":3,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.248},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48299999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Aug 9 14:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.373},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":158406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.27400000000000002}]},{"osd":3,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.379}]},{"osd":4,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Aug 9 14:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76500000000000001}]},{"osd":7,"last update":"Wed Aug 9 14:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80100000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":750422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.746}]},{"osd":4,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":151789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":3.0070000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.2009999999999996,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.34599999999999997}]},{"osd":3,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.622},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.0539999999999998,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed Aug 9 14:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":0.70699999999999996}]},{"osd":7,"last update":"Wed Aug 9 14:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":152254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.31}]},{"osd":1,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":158976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.35499999999999998}]},{"osd":1,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59499999999999997}]},{"osd":5,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.33800000000000002}]},{"osd":7,"last update":"Wed Aug 9 14:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-09T14:16:31.920 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T14:16:31.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T14:16:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.082+0000 7f477e96d700 1 Processor -- start 2023-08-09T14:16:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.082+0000 7f477e96d700 1 -- start start 2023-08-09T14:16:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f477e96d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47780ccd40 0x7f477806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f477e96d700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f47780b0420 0x7f47780d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f477e96d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477806bce0 con 0x7f47780cc960 2023-08-09T14:16:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f477e96d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477806cb50 con 0x7f47780ccd40 2023-08-09T14:16:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f477e96d700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477806ccf0 con 0x7f47780b0420 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f47777fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47780ccd40 0x7f477806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f4777fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47780cc960 0x7f4778160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58166/0 (socket says 172.21.15.5:58166) 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f4777fff700 1 -- 172.21.15.5:0/4027037086 learned_addr learned my addr 172.21.15.5:0/4027037086 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.083+0000 7f47777fe700 1 --2- 172.21.15.5:0/4027037086 >> v2:172.21.15.5:3300/0 conn(0x7f47780ccd40 0x7f477806c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44752/0 (socket says 172.21.15.5:44752) 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f477cf0a700 1 --2- 172.21.15.5:0/4027037086 >> v2:172.21.15.101:3300/0 conn(0x7f47780b0420 0x7f47780d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f47777fe700 1 -- 172.21.15.5:0/4027037086 >> v2:172.21.15.101:3300/0 conn(0x7f47780b0420 msgr2=0x7f47780d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f47777fe700 1 --2- 172.21.15.5:0/4027037086 >> v2:172.21.15.101:3300/0 conn(0x7f47780b0420 0x7f47780d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f47777fe700 1 -- 172.21.15.5:0/4027037086 >> v1:172.21.15.5:6789/0 conn(0x7f47780cc960 legacy=0x7f4778160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f47777fe700 1 -- 172.21.15.5:0/4027037086 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477806c210 con 0x7f47780ccd40 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f4776ffd700 1 -- 172.21.15.5:0/4027037086 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308220758 0 0) 0x7f477806bce0 con 0x7f47780cc960 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f47777fe700 1 --2- 172.21.15.5:0/4027037086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f477806c610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f477806eb90 tx=0x7f4760009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62dc559553b448e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f4776ffd700 1 -- 172.21.15.5:0/4027037086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760011830 con 0x7f47780ccd40 2023-08-09T14:16:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f4776ffd700 1 -- 172.21.15.5:0/4027037086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4760011990 con 0x7f47780ccd40 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.084+0000 7f4776ffd700 1 -- 172.21.15.5:0/4027037086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760011d20 con 0x7f47780ccd40 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 -- 172.21.15.5:0/4027037086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 msgr2=0x7f477806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 --2- 172.21.15.5:0/4027037086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f477806c610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f477806eb90 tx=0x7f4760009b20 comp rx=0 tx=0).stop 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 -- 172.21.15.5:0/4027037086 shutdown_connections 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 --2- 172.21.15.5:0/4027037086 >> v2:172.21.15.101:3300/0 conn(0x7f47780b0420 0x7f47780d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 --2- 172.21.15.5:0/4027037086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f477806c610 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 -- 172.21.15.5:0/4027037086 >> 172.21.15.5:0/4027037086 conn(0x7f477806dec0 msgr2=0x7f477806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 -- 172.21.15.5:0/4027037086 shutdown_connections 2023-08-09T14:16:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.085+0000 7f477e96d700 1 -- 172.21.15.5:0/4027037086 wait complete. 2023-08-09T14:16:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.086+0000 7f477e96d700 1 Processor -- start 2023-08-09T14:16:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 -- start start 2023-08-09T14:16:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 0x7f47780c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 0x7f477815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47780caed0 con 0x7f47780ccd40 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c6840 con 0x7f47780b0420 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.087+0000 7f477e96d700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c6b20 con 0x7f47780cc960 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 -- 172.21.15.5:0/3942686443 learned_addr learned my addr 172.21.15.5:0/3942686443 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f47777fe700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 0x7f477815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f4777fff700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 0x7f47780c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 -- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 msgr2=0x7f477815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 0x7f477815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 -- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 msgr2=0x7f47780c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 0x7f47780c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 -- 172.21.15.5:0/3942686443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600094a0 con 0x7f47780ccd40 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f47777fe700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 0x7f477815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f4777fff700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 0x7f47780c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477cf0a700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f477000efc0 tx=0x7f477000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770009ba0 con 0x7f47780ccd40 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000f040 con 0x7f47780ccd40 2023-08-09T14:16:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47780c6e00 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770014480 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.088+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47780c73c0 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.089+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47780c75e0 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.090+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47700145e0 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.090+0000 7f4774ff9700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 0x7f475806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.090+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4770088d90 con 0x7f47780ccd40 2023-08-09T14:16:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.090+0000 7f4777fff700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 0x7f475806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.091+0000 7f4777fff700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 0x7f475806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4768007fd0 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.094+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4770054510 con 0x7f47780ccd40 2023-08-09T14:16:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.373+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4778161520 con 0x7f47780ccd40 2023-08-09T14:16:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.377+0000 7f4774ff9700 1 -- 172.21.15.5:0/3942686443 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f47700180e0 con 0x7f47780ccd40 2023-08-09T14:16:32.414 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-08-09T14:16:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMn9NkwcnEJhAANZnn6ZDBepG6wauF6Holcg== 2023-08-09T14:16:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-08-09T14:16:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-08-09T14:16:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T14:16:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 msgr2=0x7f475806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 0x7f475806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4768007fd0 tx=0x7f4768009040 comp rx=0 tx=0).stop 2023-08-09T14:16:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 msgr2=0x7f47780c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f477000efc0 tx=0x7f477000c3a0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 shutdown_connections 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f475806a0e0 0x7f475806c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47780ccd40 0x7f47780c7f30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f47780b0420 0x7f47780c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 --2- 172.21.15.5:0/3942686443 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f47780cc960 0x7f477815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 >> 172.21.15.5:0/3942686443 conn(0x7f477806dec0 msgr2=0x7f47780cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:32.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 shutdown_connections 2023-08-09T14:16:32.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.379+0000 7f477e96d700 1 -- 172.21.15.5:0/3942686443 wait complete. 2023-08-09T14:16:32.418 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-08-09T14:16:32.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T14:16:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.541+0000 7f60ed833700 1 Processor -- start 2023-08-09T14:16:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 -- start start 2023-08-09T14:16:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e815e750 0x7f60e80cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 0x7f60e80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e80b1df0 0x7f60e80cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80cfc10 con 0x7f60e80b1df0 2023-08-09T14:16:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80cf000 con 0x7f60e80cea90 2023-08-09T14:16:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60ed833700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80cf2e0 con 0x7f60e815e750 2023-08-09T14:16:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60e77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e80b1df0 0x7f60e80cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.542+0000 7f60e77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e80b1df0 0x7f60e80cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44768/0 (socket says 172.21.15.5:44768) 2023-08-09T14:16:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 -- 172.21.15.5:0/3501318823 learned_addr learned my addr 172.21.15.5:0/3501318823 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e67fc700 1 --2- 172.21.15.5:0/3501318823 >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 0x7f60e80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e6ffd700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e815e750 0x7f60e80cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 -- 172.21.15.5:0/3501318823 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e815e750 msgr2=0x7f60e80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e815e750 0x7f60e80cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 -- 172.21.15.5:0/3501318823 >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 msgr2=0x7f60e80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 --2- 172.21.15.5:0/3501318823 >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 0x7f60e80cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 -- 172.21.15.5:0/3501318823 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80cf5c0 con 0x7f60e80b1df0 2023-08-09T14:16:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e67fc700 1 --2- 172.21.15.5:0/3501318823 >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 0x7f60e80cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e77fe700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e80cbad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f60e809a920 tx=0x7f60e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec4ae81ea295591 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e5ffb700 1 -- 172.21.15.5:0/3501318823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000e070 con 0x7f60e80b1df0 2023-08-09T14:16:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e5ffb700 1 -- 172.21.15.5:0/3501318823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000b9c0 con 0x7f60e80b1df0 2023-08-09T14:16:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.543+0000 7f60e5ffb700 1 -- 172.21.15.5:0/3501318823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000bd70 con 0x7f60e80b1df0 2023-08-09T14:16:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 -- 172.21.15.5:0/3501318823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 msgr2=0x7f60e80cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e80cbad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f60e809a920 tx=0x7f60e000b330 comp rx=0 tx=0).stop 2023-08-09T14:16:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 -- 172.21.15.5:0/3501318823 shutdown_connections 2023-08-09T14:16:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e80cbad0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 --2- 172.21.15.5:0/3501318823 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e815e750 0x7f60e80cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 --2- 172.21.15.5:0/3501318823 >> v2:172.21.15.101:3300/0 conn(0x7f60e80cea90 0x7f60e80cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 -- 172.21.15.5:0/3501318823 >> 172.21.15.5:0/3501318823 conn(0x7f60e809a180 msgr2=0x7f60e80d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 -- 172.21.15.5:0/3501318823 shutdown_connections 2023-08-09T14:16:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.544+0000 7f60ed833700 1 -- 172.21.15.5:0/3501318823 wait complete. 2023-08-09T14:16:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.545+0000 7f60ed833700 1 Processor -- start 2023-08-09T14:16:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.545+0000 7f60ed833700 1 -- start start 2023-08-09T14:16:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e80cea90 0x7f60e80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60e815e750 0x7f60e80b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80cb060 con 0x7f60e80b1df0 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80b4980 con 0x7f60e815e750 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60ed833700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80b4c60 con 0x7f60e80cea90 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44770/0 (socket says 172.21.15.5:44770) 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 -- 172.21.15.5:0/56628472 learned_addr learned my addr 172.21.15.5:0/56628472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e67fc700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e80cea90 0x7f60e80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e77fe700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60e815e750 0x7f60e80b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 -- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e80cea90 msgr2=0x7f60e80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e80cea90 0x7f60e80b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 -- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60e815e750 msgr2=0x7f60e80b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60e815e750 0x7f60e80b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 -- 172.21.15.5:0/56628472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009b30 con 0x7f60e80b1df0 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.546+0000 7f60e6ffd700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c7f0 tx=0x7f60d000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.547+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011800 con 0x7f60e80b1df0 2023-08-09T14:16:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.547+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0011960 con 0x7f60e80b1df0 2023-08-09T14:16:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.547+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e80b4f40 con 0x7f60e80b1df0 2023-08-09T14:16:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.547+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011cf0 con 0x7f60e80b1df0 2023-08-09T14:16:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.547+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e80b5500 con 0x7f60e80b1df0 2023-08-09T14:16:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.548+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8074600 con 0x7f60e80b1df0 2023-08-09T14:16:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.548+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60d0018360 con 0x7f60e80b1df0 2023-08-09T14:16:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.548+0000 7f60dffff700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 0x7f60c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.549+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60d0088380 con 0x7f60e80b1df0 2023-08-09T14:16:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.549+0000 7f60e67fc700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 0x7f60c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.549+0000 7f60e67fc700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 0x7f60c806c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ca560 tx=0x7f60d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.553+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f60d0053b00 con 0x7f60e80b1df0 2023-08-09T14:16:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.800+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e80b3340 con 0x7f60e80b1df0 2023-08-09T14:16:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.801+0000 7f60dffff700 1 -- 172.21.15.5:0/56628472 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f60d0057120 con 0x7f60e80b1df0 2023-08-09T14:16:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:32.803 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6837/4007626462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6835","nonce":4007626462},{"type":"v1","addr":"172.21.15.101:6837","nonce":4007626462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.101:6836/1598020382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6834","nonce":1598020382},{"type":"v1","addr":"172.21.15.101:6836","nonce":1598020382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1624368883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1624368883},{"type":"v1","addr":"172.21.15.5:6835","nonce":1624368883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T14:16:26.782509+0000","modified":"2023-08-09T14:16:30.379487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5154},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5154":{"gid":5154,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/3709637189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3709637189},{"type":"v1","addr":"172.21.15.5:6833","nonce":3709637189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T14:16:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 msgr2=0x7f60c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 0x7f60c806c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ca560 tx=0x7f60d8008040 comp rx=0 tx=0).stop 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 msgr2=0x7f60e8149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c7f0 tx=0x7f60d000cbb0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 shutdown_connections 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f60c806a0e0 0x7f60c806c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f60e815e750 0x7f60e80b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b1df0 0x7f60e8149270 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 --2- 172.21.15.5:0/56628472 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f60e80cea90 0x7f60e80b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 >> 172.21.15.5:0/56628472 conn(0x7f60e809a180 msgr2=0x7f60e815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 shutdown_connections 2023-08-09T14:16:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:32.803+0000 7f60ed833700 1 -- 172.21.15.5:0/56628472 wait complete. 2023-08-09T14:16:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2023-08-09T14:16:33.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T14:16:26.782509+0000', 'modified': '2023-08-09T14:16:30.379487+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5154}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5154': {'gid': 5154, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6833/3709637189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3709637189}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3709637189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T14:16:33.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T14:16:33.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-09T14:16:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.350+0000 7f4bdfd1f700 1 Processor -- start 2023-08-09T14:16:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.350+0000 7f4bdfd1f700 1 -- start start 2023-08-09T14:16:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.351+0000 7f4bdfd1f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f4bd815e680 0x7f4bd8071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdfd1f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80aec20 con 0x7f4bd80cefd0 2023-08-09T14:16:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdfd1f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd815ead0 con 0x7f4bd815db90 2023-08-09T14:16:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdfd1f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80cb660 con 0x7f4bd815e680 2023-08-09T14:16:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdd2ba700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bd80cefd0 0x7f4bd815df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58194/0 (socket says 172.21.15.5:58194) 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdd2ba700 1 -- 172.21.15.5:0/3045600136 learned_addr learned my addr 172.21.15.5:0/3045600136 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3045600136 >> v2:172.21.15.101:3300/0 conn(0x7f4bd815e680 0x7f4bd8071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062143661 0 0) 0x7f4bd80aec20 con 0x7f4bd80cefd0 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc40035b0 con 0x7f4bd80cefd0 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201052421 0 0) 0x7f4bd815ead0 con 0x7f4bd815db90 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd80aec20 con 0x7f4bd815db90 2023-08-09T14:16:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977774545 0 0) 0x7f4bc40035b0 con 0x7f4bd80cefd0 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 >> v2:172.21.15.101:3300/0 conn(0x7f4bd815e680 msgr2=0x7f4bd8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 --2- 172.21.15.5:0/3045600136 >> v2:172.21.15.101:3300/0 conn(0x7f4bd815e680 0x7f4bd8071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 >> v1:172.21.15.101:6789/0 conn(0x7f4bd815db90 legacy=0x7f4bd806b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80cb0c0 con 0x7f4bd80cefd0 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4066296028 0 0) 0x7f4bd4001670 con 0x7f4bd80cefd0 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 >> v1:172.21.15.5:6789/0 conn(0x7f4bd80cefd0 legacy=0x7f4bd815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bc4003b90 0x7f4bc4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bc4004850 0x7f4bc4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80cb660 con 0x7f4bc4005210 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400c140 con 0x7f4bc4004850 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.352+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400c300 con 0x7f4bc4003b90 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bc400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bc4003b90 0x7f4bc4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bc4004850 0x7f4bc4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bc4003b90 msgr2=0x7f4bc4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bc4003b90 0x7f4bc4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bc4004850 msgr2=0x7f4bc4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bc4004850 0x7f4bc4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3045600136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40035b0 con 0x7f4bc4005210 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3045600136 reap_dead start 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bc400ba10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009fc0 tx=0x7f4bc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a4762b6a02c2ed server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003a20 con 0x7f4bc4005210 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000f040 con 0x7f4bc4005210 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.353+0000 7f4bdcab9700 1 -- 172.21.15.5:0/3045600136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003da0 con 0x7f4bc4005210 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 msgr2=0x7f4bc400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bc400ba10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009fc0 tx=0x7f4bc4005880 comp rx=0 tx=0).stop 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/3045600136 shutdown_connections 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/3045600136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bc400ba10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/3045600136 >> 172.21.15.5:0/3045600136 conn(0x7f4bd80cf560 msgr2=0x7f4bd80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/3045600136 shutdown_connections 2023-08-09T14:16:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.354+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/3045600136 wait complete. 2023-08-09T14:16:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.355+0000 7f4bdfd1f700 1 Processor -- start 2023-08-09T14:16:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.355+0000 7f4bdfd1f700 1 -- start start 2023-08-09T14:16:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bd80adfb0 0x7f4bd81474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 0x7f4bd8147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd8147f60 con 0x7f4bc4005210 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80accc0 con 0x7f4bd80adfb0 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80acfa0 con 0x7f4bd80ae410 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44790/0 (socket says 172.21.15.5:44790) 2023-08-09T14:16:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 -- 172.21.15.5:0/36712794 learned_addr learned my addr 172.21.15.5:0/36712794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bd80adfb0 0x7f4bd81474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 0x7f4bd8147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 -- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 msgr2=0x7f4bd8147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 0x7f4bd8147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 -- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bd80adfb0 msgr2=0x7f4bd81474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bd80adfb0 0x7f4bd81474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 -- 172.21.15.5:0/36712794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80ad280 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 0x7f4bd8147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bddabb700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800f770 tx=0x7f4bc800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bce7fc700 1 -- 172.21.15.5:0/36712794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8005320 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bce7fc700 1 -- 172.21.15.5:0/36712794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc80054a0 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd80ad560 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.356+0000 7f4bce7fc700 1 -- 172.21.15.5:0/36712794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8006aa0 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.357+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd80ac8b0 con 0x7f4bc4005210 2023-08-09T14:16:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.358+0000 7f4bce7fc700 1 -- 172.21.15.5:0/36712794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4bc8006c00 con 0x7f4bc4005210 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.358+0000 7f4bce7fc700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 0x7f4bbc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.359+0000 7f4bce7fc700 1 -- 172.21.15.5:0/36712794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bc8087ee0 con 0x7f4bc4005210 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.359+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 0x7f4bbc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.359+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 0x7f4bbc06c5d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806ad60 tx=0x7f4bd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 Processor -- start 2023-08-09T14:16:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 -- start start 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e88cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258db7060 con 0x556258e9a330 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.361+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258db4980 con 0x556258e5b070 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x556258db0270 con 0x556258e88910 2023-08-09T14:16:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44802/0 (socket says 172.21.15.5:44802) 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 -- 172.21.15.5:0/867422182 learned_addr learned my addr 172.21.15.5:0/867422182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bddabb700 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e88cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 -- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 msgr2=0x556258ea41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 -- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 msgr2=0x556258e88cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e88cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 -- 172.21.15.5:0/867422182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556258c305e0 con 0x556258e9a330 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ccf50 tx=0x7f4bd0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee2ece66cd5d2d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bbb7fe700 1 -- 172.21.15.5:0/867422182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003a20 con 0x556258e9a330 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bbb7fe700 1 -- 172.21.15.5:0/867422182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0003b80 con 0x556258e9a330 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.362+0000 7f4bbb7fe700 1 -- 172.21.15.5:0/867422182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000ea30 con 0x556258e9a330 2023-08-09T14:16:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/867422182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 msgr2=0x556258e5e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ccf50 tx=0x7f4bd0011000 comp rx=0 tx=0).stop 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/867422182 shutdown_connections 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e5e300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/867422182 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e88cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/867422182 >> 172.21.15.5:0/867422182 conn(0x556258d8c130 msgr2=0x556258ea3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/867422182 shutdown_connections 2023-08-09T14:16:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.363+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/867422182 wait complete. 2023-08-09T14:16:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.364+0000 7f4bebeb8b80 1 -- start start 2023-08-09T14:16:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.364+0000 7f4bebeb8b80 1 Processor -- start 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e5d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258e6cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258d4ea70 con 0x556258e9a330 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258d4e770 con 0x556258e5b070 2023-08-09T14:16:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x556258c328d0 con 0x556258e88910 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 10 client.0 _ll_register_callbacks cb 0x556258d4c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44808/0 (socket says 172.21.15.5:44808) 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3813065142 learned_addr learned my addr 172.21.15.5:0/3813065142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258e6cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e5d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 msgr2=0x556258e6cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258e6cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 msgr2=0x556258e5d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e5d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3813065142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc40035b0 con 0x556258e9a330 2023-08-09T14:16:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009f90 tx=0x7f4bd0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdb5b0bcd01e0e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0014790 con 0x556258e9a330 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556258d521a0 con 0x556258e9a330 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.365+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bd00148f0 con 0x556258e9a330 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bd0014ab0 con 0x556258e9a330 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 10 client.5331 fetch_fsmap learned FSMap version 15 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556258bdcd90 con 0x556258e9a330 2023-08-09T14:16:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556258d521a0 con 0x556258e9a330 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4bd0014c10 con 0x556258e9a330 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 10 client.5331 fetch_fsmap finished waiting for FSMap version 15 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 10 client.5331 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 20 client.5331 populate_metadata read hostname 'smithi005' 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258ea77d0 0x556258e69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 4 client.5331 mds_command: new command op to 5154 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 --> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556258da9250 con 0x556258ea77d0 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258ea77d0 0x556258e69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bb8ff9700 10 client.5331 ms_handle_connect on v2:172.21.15.5:6832/3709637189 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.366+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258ea77d0 0x556258e69cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ad9908d37dc9f02 server_cookie=ac67c5bff0332789 in_seq=0 out_seq=0 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3813065142 <== mds.0 v2:172.21.15.5:6832/3709637189 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556258da9250 con 0x556258ea77d0 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bb8ff9700 10 client.5331 handle_command_reply: tid=0 2023-08-09T14:16:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 client.5331 shutdown 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 msgr2=0x556258e6d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009f90 tx=0x7f4bd0004b40 comp rx=0 tx=0).stop 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 shutdown_connections 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258ea77d0 0x556258e69cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e6d320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e5d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bb8ff9700 0 client.5331 ms_handle_reset on v2:172.21.15.5:6832/3709637189 2023-08-09T14:16:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3813065142 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258e6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 >> 172.21.15.5:0/3813065142 conn(0x556258d8c130 msgr2=0x556258e58650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 shutdown_connections 2023-08-09T14:16:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3813065142 wait complete. 2023-08-09T14:16:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.367+0000 7f4bebeb8b80 20 client.5331 trim_cache size 0 max 16384 2023-08-09T14:16:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.385+0000 7f4bebeb8b80 1 Processor -- start 2023-08-09T14:16:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.385+0000 7f4bebeb8b80 1 -- start start 2023-08-09T14:16:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e9a330 0x556258e58560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258e6a150 con 0x556258e88910 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258ea3d20 con 0x556258e5b070 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x556258e88420 con 0x556258e9a330 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44814/0 (socket says 172.21.15.5:44814) 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 -- 172.21.15.5:0/3994108239 learned_addr learned my addr 172.21.15.5:0/3994108239 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 -- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e9a330 msgr2=0x556258e58560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e9a330 0x556258e58560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 -- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 msgr2=0x556258e898c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e898c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 -- 172.21.15.5:0/3994108239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556258bc5c10 con 0x556258e88910 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.386+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40071c0 tx=0x7f4bd4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72158e4d820e882b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bbbfff700 1 -- 172.21.15.5:0/3994108239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4015700 con 0x556258e88910 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bbbfff700 1 -- 172.21.15.5:0/3994108239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd4015860 con 0x556258e88910 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bbbfff700 1 -- 172.21.15.5:0/3994108239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4015bd0 con 0x556258e88910 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3994108239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 msgr2=0x556258e88ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40071c0 tx=0x7f4bd4014000 comp rx=0 tx=0).stop 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3994108239 shutdown_connections 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e9a330 0x556258e58560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3994108239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e88910 0x556258e88ee0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3994108239 >> 172.21.15.5:0/3994108239 conn(0x556258d8c130 msgr2=0x556258e5a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3994108239 shutdown_connections 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.387+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3994108239 wait complete. 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.388+0000 7f4bebeb8b80 1 -- start start 2023-08-09T14:16:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.388+0000 7f4bebeb8b80 1 Processor -- start 2023-08-09T14:16:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e6cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258e6d4a0 con 0x556258e9a330 2023-08-09T14:16:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x556258e68960 con 0x556258e5b070 2023-08-09T14:16:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x556258e8b510 con 0x556258e88910 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bebeb8b80 10 client.0 _ll_register_callbacks cb 0x556258d4c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44822/0 (socket says 172.21.15.5:44822) 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3220738495 learned_addr learned my addr 172.21.15.5:0/3220738495 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bdd2ba700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e6cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 msgr2=0x556258ea2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 msgr2=0x556258e6cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e6cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.389+0000 7f4bde2bc700 1 -- 172.21.15.5:0/3220738495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd80cb0c0 con 0x556258e9a330 2023-08-09T14:16:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bde2bc700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0014fb0 tx=0x7f4bd0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4567abb29cd546e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd001d6c0 con 0x556258e9a330 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bd0003b80 con 0x556258e9a330 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bd0014790 con 0x556258e9a330 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bd0014990 con 0x556258e9a330 2023-08-09T14:16:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 10 client.5337 fetch_fsmap learned FSMap version 15 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556258c03200 con 0x556258e9a330 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0003b80 con 0x556258e9a330 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4bd0014af0 con 0x556258e9a330 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 10 client.5337 fetch_fsmap finished waiting for FSMap version 15 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 10 client.5337 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 20 client.5337 populate_metadata read hostname 'smithi005' 2023-08-09T14:16:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258f00800 0x556258f0e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 4 client.5337 mds_command: new command op to 5154 tid=0[{"prefix": "status"}] 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 --> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556258d6a000 con 0x556258f00800 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.390+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258f00800 0x556258f0e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bb8ff9700 10 client.5337 ms_handle_connect on v2:172.21.15.5:6832/3709637189 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bddabb700 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258f00800 0x556258f0e2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c7bdfe2df69dd5 server_cookie=c16fa17789e829f3 in_seq=0 out_seq=0 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bb8ff9700 1 -- 172.21.15.5:0/3220738495 <== mds.0 v2:172.21.15.5:6832/3709637189 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556258d6a000 con 0x556258f00800 2023-08-09T14:16:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bb8ff9700 10 client.5337 handle_command_reply: tid=0 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 client.5337 shutdown 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 msgr2=0x556258e89e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0014fb0 tx=0x7f4bd0009750 comp rx=0 tx=0).stop 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 shutdown_connections 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:6832/3709637189,v1:172.21.15.5:6833/3709637189] conn(0x556258f00800 0x556258f0e2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556258e9a330 0x556258e89e60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x556258e5b070 0x556258e6cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bb8ff9700 0 client.5337 ms_handle_reset on v2:172.21.15.5:6832/3709637189 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 --2- 172.21.15.5:0/3220738495 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x556258e88910 0x556258ea2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 >> 172.21.15.5:0/3220738495 conn(0x556258d8c130 msgr2=0x556258e8a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 shutdown_connections 2023-08-09T14:16:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.391+0000 7f4bebeb8b80 1 -- 172.21.15.5:0/3220738495 wait complete. 2023-08-09T14:16:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bebeb8b80 20 client.5337 trim_cache size 0 max 16384 2023-08-09T14:16:33.406 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-08-09T14:16:33.406 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "59d7238d-6ce2-4e7c-9329-64c716150f65", 2023-08-09T14:16:33.406 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-08-09T14:16:33.407 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5154, 2023-08-09T14:16:33.407 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-08-09T14:16:33.407 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-08-09T14:16:33.408 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-08-09T14:16:33.408 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.0354571019999996, 2023-08-09T14:16:33.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 15, 2023-08-09T14:16:33.409 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 34, 2023-08-09T14:16:33.409 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 34, 2023-08-09T14:16:33.409 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.970621142000001 2023-08-09T14:16:33.410 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-08-09T14:16:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 msgr2=0x7f4bbc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 0x7f4bbc06c5d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806ad60 tx=0x7f4bd4009040 comp rx=0 tx=0).stop 2023-08-09T14:16:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 msgr2=0x7f4bd806a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800f770 tx=0x7f4bc800fb30 comp rx=0 tx=0).stop 2023-08-09T14:16:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 shutdown_connections 2023-08-09T14:16:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4bbc06a110 0x7f4bbc06c5d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4bd80ae410 0x7f4bd8147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4005210 0x7f4bd806a430 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 --2- 172.21.15.5:0/36712794 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4bd80adfb0 0x7f4bd81474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 >> 172.21.15.5:0/36712794 conn(0x7f4bd80cf560 msgr2=0x7f4bd81585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 shutdown_connections 2023-08-09T14:16:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.392+0000 7f4bdfd1f700 1 -- 172.21.15.5:0/36712794 wait complete. 2023-08-09T14:16:33.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T14:16:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.539+0000 7f1236738700 1 Processor -- start 2023-08-09T14:16:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.539+0000 7f1236738700 1 -- start start 2023-08-09T14:16:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1236738700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12300ce410 0x7f12300ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1236738700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12300cee00 con 0x7f123015b360 2023-08-09T14:16:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1236738700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123015eb20 con 0x7f1230154600 2023-08-09T14:16:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1236738700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123015e2d0 con 0x7f12300ce410 2023-08-09T14:16:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12300ce410 0x7f12300ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f122f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f123015b360 0x7f123015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58242/0 (socket says 172.21.15.5:58242) 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12300ce410 0x7f12300ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44830/0 (socket says 172.21.15.5:44830) 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f122f7fe700 1 -- 172.21.15.5:0/3023864450 learned_addr learned my addr 172.21.15.5:0/3023864450 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 -- 172.21.15.5:0/3023864450 >> v1:172.21.15.101:6789/0 conn(0x7f1230154600 legacy=0x7f123015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 -- 172.21.15.5:0/3023864450 >> v1:172.21.15.5:6789/0 conn(0x7f123015b360 legacy=0x7f123015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 -- 172.21.15.5:0/3023864450 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123006d4f0 con 0x7f12300ce410 2023-08-09T14:16:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f122effd700 1 -- 172.21.15.5:0/3023864450 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522812338 0 0) 0x7f1220001110 con 0x7f123015b360 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.540+0000 7f1234cd5700 1 --2- 172.21.15.5:0/3023864450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12300ce410 0x7f12300ce8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1228009d90 tx=0x7f122800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3478fd7c14b072f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f122effd700 1 -- 172.21.15.5:0/3023864450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800e070 con 0x7f12300ce410 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f122effd700 1 -- 172.21.15.5:0/3023864450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122800bb90 con 0x7f12300ce410 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f122effd700 1 -- 172.21.15.5:0/3023864450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228003a20 con 0x7f12300ce410 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 -- 172.21.15.5:0/3023864450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12300ce410 msgr2=0x7f12300ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 --2- 172.21.15.5:0/3023864450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12300ce410 0x7f12300ce8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1228009d90 tx=0x7f122800b330 comp rx=0 tx=0).stop 2023-08-09T14:16:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 -- 172.21.15.5:0/3023864450 shutdown_connections 2023-08-09T14:16:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 --2- 172.21.15.5:0/3023864450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12300ce410 0x7f12300ce8c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 -- 172.21.15.5:0/3023864450 >> 172.21.15.5:0/3023864450 conn(0x7f12300b1900 msgr2=0x7f12300b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 -- 172.21.15.5:0/3023864450 shutdown_connections 2023-08-09T14:16:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.541+0000 7f1236738700 1 -- 172.21.15.5:0/3023864450 wait complete. 2023-08-09T14:16:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.542+0000 7f1236738700 1 Processor -- start 2023-08-09T14:16:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 -- start start 2023-08-09T14:16:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f12300ce410 0x7f123006a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f123015b360 0x7f1230146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230159e90 con 0x7f1230154600 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230159280 con 0x7f123015b360 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1236738700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1230159560 con 0x7f12300ce410 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f122f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f122f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44834/0 (socket says 172.21.15.5:44834) 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f122f7fe700 1 -- 172.21.15.5:0/4185645522 learned_addr learned my addr 172.21.15.5:0/4185645522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f122ffff700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f12300ce410 0x7f123006a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.543+0000 7f1234cd5700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f123015b360 0x7f1230146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 -- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f12300ce410 msgr2=0x7f123006a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f12300ce410 0x7f123006a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 -- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f123015b360 msgr2=0x7f1230146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f123015b360 0x7f1230146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 -- 172.21.15.5:0/4185645522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228009a70 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122f7fe700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f122000c520 tx=0x7f122000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220004c80 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220004de0 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230159840 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200072d0 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.544+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123006a970 con 0x7f1230154600 2023-08-09T14:16:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.545+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123006abc0 con 0x7f1230154600 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.545+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1220007430 con 0x7f1230154600 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.546+0000 7f122cff9700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 0x7f121006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.546+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1220087fb0 con 0x7f1230154600 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.546+0000 7f122ffff700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 0x7f121006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.546+0000 7f122ffff700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 0x7f121006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1218007fd0 tx=0x7f1218007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:33.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.550+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f12200ba7b0 con 0x7f1230154600 2023-08-09T14:16:33.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:16:33.642 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:16:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.797+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12300cee00 con 0x7f1230154600 2023-08-09T14:16:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.797+0000 7f122cff9700 1 -- 172.21.15.5:0/4185645522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12300cee00 con 0x7f1230154600 2023-08-09T14:16:33.800 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T14:16:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 msgr2=0x7f121006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 0x7f121006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1218007fd0 tx=0x7f1218007ec0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 msgr2=0x7f123015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f122000c520 tx=0x7f122000c830 comp rx=0 tx=0).stop 2023-08-09T14:16:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 shutdown_connections 2023-08-09T14:16:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f121006a0e0 0x7f121006c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f123015b360 0x7f1230146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f12300ce410 0x7f123006a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 --2- 172.21.15.5:0/4185645522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1230154600 0x7f123015aa30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 >> 172.21.15.5:0/4185645522 conn(0x7f12300b1900 msgr2=0x7f123006dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 shutdown_connections 2023-08-09T14:16:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:33.800+0000 7f1236738700 1 -- 172.21.15.5:0/4185645522 wait complete. 2023-08-09T14:16:33.814 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T14:16:33.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T14:16:33.815 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-08-09T14:16:33.815 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T14:16:33.815 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T14:16:33.815 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T14:16:33.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T14:16:33.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T14:16:33.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T14:16:33.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:33.817 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-08-09T14:16:33.835 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T14:16:33.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T14:16:33.836 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T14:16:33.836 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.836 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-08-09T14:16:33.836 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.837 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:16:33.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-08-09T14:16:33.837 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:16:33.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-08-09T14:16:33.837 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T14:16:33.838 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:16:33.838 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T14:16:33.838 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-08-09T14:16:33.838 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-08-09T14:16:33.839 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.839 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T14:16:33.839 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:16:33.839 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T14:16:33.840 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5a:ba:3e:17:2a:e9 brd ff:ff:ff:ff:ff:ff 2023-08-09T14:16:33.840 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T14:16:33.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.841 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a822:11ff:fe93:cb20/64 scope link 2023-08-09T14:16:33.841 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.841 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T14:16:33.841 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e2:3a:68:45:72:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T14:16:33.842 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e03a:68ff:fe45:72e7/64 scope link 2023-08-09T14:16:33.842 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.842 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T14:16:33.842 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5a:ba:3e:17:2a:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T14:16:33.843 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::58ba:3eff:fe17:2ae9/64 scope link 2023-08-09T14:16:33.843 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-08-09T14:16:33.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:33.844 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T14:16:33.900 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-08-09T14:16:33.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:33.902 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-08-09T14:16:33.961 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-08-09T14:16:33.961 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T14:16:33.961 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T14:16:33.961 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T14:16:33.961 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T14:16:33.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:33.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-08-09T14:16:33.963 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-08-09T14:16:33.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T14:16:33.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T14:16:33.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T14:16:33.964 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-08-09T14:16:34.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.068 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-08-09T14:16:34.085 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T14:16:34.085 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T14:16:34.085 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T14:16:34.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-08-09T14:16:34.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:16:34.153 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T14:16:34.210 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T14:16:34.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T14:16:34.211 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T14:16:34.266 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-09T14:16:34.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:16:34.353 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:16:34.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:16:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:16:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:16:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:16:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:16:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:16:34.386 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:16:34.386 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:16:34.386 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:16:34.459 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-09T14:16:34.459 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.101:3300,172.21.15.101:3301" 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@59d7238d-6ce2-4e7c-9329-64c716150f65.cephfs=/ 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.101:3300/172.21.15.101:3301" will pass to kernel 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790" 2023-08-09T14:16:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.101:6789,172.21.15.101:6790:/ 2023-08-09T14:16:34.461 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65" will pass to kernel 2023-08-09T14:16:34.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T14:16:34.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T14:16:34.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.492 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T14:16:34.575 INFO:teuthology.orchestra.run.smithi005.stdout:client5200 2023-08-09T14:16:34.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:34.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:16:34.593 DEBUG:teuthology.orchestra.run.smithi005:> mktemp -d --suffix=xfstests-dev 2023-08-09T14:16:34.649 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.cj6W3QcazExfstests-dev 2023-08-09T14:16:34.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.cj6W3QcazExfstests-dev) 2023-08-09T14:16:34.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:34.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.cj6W3QcazExfstests-dev) 2023-08-09T14:16:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:Cloning into '/tmp/tmp.cj6W3QcazExfstests-dev'... 2023-08-09T14:16:35.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:35.453 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-09T14:16:35.515 DEBUG:teuthology.orchestra.run.smithi005:> mktemp -d --suffix=test 2023-08-09T14:16:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:16:35.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:16:35.573 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-09T14:16:35.631 DEBUG:teuthology.orchestra.run.smithi005:> mktemp -d --suffix=scratch 2023-08-09T14:16:35.687 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:16:35.687 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-08-09T14:16:35.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-08-09T14:16:36.107 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-08-09T14:16:37.007 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:04:08 ago on Wed 09 Aug 2023 02:12:29 PM UTC. 2023-08-09T14:16:38.449 INFO:teuthology.orchestra.run.smithi005.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-08-09T14:16:38.450 INFO:teuthology.orchestra.run.smithi005.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-08-09T14:16:38.452 INFO:teuthology.orchestra.run.smithi005.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-08-09T14:16:38.453 INFO:teuthology.orchestra.run.smithi005.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-08-09T14:16:38.454 INFO:teuthology.orchestra.run.smithi005.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-08-09T14:16:38.456 INFO:teuthology.orchestra.run.smithi005.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-08-09T14:16:38.458 INFO:teuthology.orchestra.run.smithi005.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-08-09T14:16:38.460 INFO:teuthology.orchestra.run.smithi005.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-08-09T14:16:38.462 INFO:teuthology.orchestra.run.smithi005.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-08-09T14:16:38.463 INFO:teuthology.orchestra.run.smithi005.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-08-09T14:16:38.464 INFO:teuthology.orchestra.run.smithi005.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-08-09T14:16:38.466 INFO:teuthology.orchestra.run.smithi005.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-08-09T14:16:38.467 INFO:teuthology.orchestra.run.smithi005.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-08-09T14:16:38.468 INFO:teuthology.orchestra.run.smithi005.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-08-09T14:16:38.469 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-09T14:16:38.470 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-09T14:16:38.471 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-09T14:16:38.473 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-09T14:16:38.474 INFO:teuthology.orchestra.run.smithi005.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-08-09T14:16:38.475 INFO:teuthology.orchestra.run.smithi005.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-08-09T14:16:38.476 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-08-09T14:16:38.481 INFO:teuthology.orchestra.run.smithi005.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-08-09T14:16:38.482 INFO:teuthology.orchestra.run.smithi005.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-08-09T14:16:38.487 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-09T14:16:38.610 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-08-09T14:16:38.611 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-08-09T14:16:38.612 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-08-09T14:16:38.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:38.614 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-08-09T14:16:38.614 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-08-09T14:16:38.614 INFO:teuthology.orchestra.run.smithi005.stdout:Install 7 Packages 2023-08-09T14:16:38.614 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2023-08-09T14:16:38.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:38.615 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.3 M 2023-08-09T14:16:38.615 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-08-09T14:16:38.749 INFO:teuthology.orchestra.run.smithi005.stdout:(1/9): rmt-1.5.3-13.el8.x86_64.rpm 484 kB/s | 51 kB 00:00 2023-08-09T14:16:38.774 INFO:teuthology.orchestra.run.smithi005.stdout:(2/9): dump-0.4-0.36.b46.el8.x86_64.rpm 1.2 MB/s | 164 kB 00:00 2023-08-09T14:16:38.808 INFO:teuthology.orchestra.run.smithi005.stdout:(3/9): daxctl-libs-71.1-3.el8.x86_64.rpm 714 kB/s | 42 kB 00:00 2023-08-09T14:16:38.833 INFO:teuthology.orchestra.run.smithi005.stdout:(4/9): ndctl-libs-71.1-3.el8.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-08-09T14:16:38.866 INFO:teuthology.orchestra.run.smithi005.stdout:(5/9): fio-3.19-3.el8.x86_64.rpm 9.0 MB/s | 538 kB 00:00 2023-08-09T14:16:38.892 INFO:teuthology.orchestra.run.smithi005.stdout:(6/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2023-08-09T14:16:38.934 INFO:teuthology.orchestra.run.smithi005.stdout:(7/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 9.7 MB/s | 668 kB 00:00 2023-08-09T14:16:38.993 INFO:teuthology.orchestra.run.smithi005.stdout:(8/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 5.6 MB/s | 581 kB 00:00 2023-08-09T14:16:39.067 INFO:teuthology.orchestra.run.smithi005.stdout:(9/9): indent-2.2.13-2.el8.x86_64.rpm 439 kB/s | 187 kB 00:00 2023-08-09T14:16:39.068 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-08-09T14:16:39.068 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.2 MB/s | 2.3 MB 00:00 2023-08-09T14:16:39.155 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-08-09T14:16:39.189 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-08-09T14:16:39.190 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-08-09T14:16:39.285 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-08-09T14:16:39.290 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-08-09T14:16:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-08-09T14:16:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-09T14:16:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-09T14:16:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-09T14:16:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-09T14:16:40.472 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-09T14:16:40.580 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-09T14:16:40.782 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-08-09T14:16:40.975 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-08-09T14:16:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-08-09T14:16:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-08-09T14:16:41.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-08-09T14:16:41.981 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : indent-2.2.13-2.el8.x86_64 9/11 2023-08-09T14:16:42.256 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-08-09T14:16:42.428 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-09T14:16:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-09T14:16:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/11 2023-08-09T14:16:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fio-3.19-3.el8.x86_64 6/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 7/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-08-09T14:16:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-08-09T14:16:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-08-09T14:16:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-09T14:16:44.029 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:04:15 ago on Wed 09 Aug 2023 02:12:29 PM UTC. 2023-08-09T14:16:47.133 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-08-09T14:16:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-2.el8.x86_64 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-08-09T14:16:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-08-09T14:16:47.344 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:47.344 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-08-09T14:16:47.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo useradd -m fsgqa 2023-08-09T14:16:47.550 INFO:teuthology.orchestra.run.smithi005.stderr:useradd: user 'fsgqa' already exists 2023-08-09T14:16:47.551 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-09T14:16:47.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo groupadd fsgqa 2023-08-09T14:16:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:groupadd: group 'fsgqa' already exists 2023-08-09T14:16:47.619 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-09T14:16:47.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo useradd fsgqa2 2023-08-09T14:16:48.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo useradd 123456-fsgqa 2023-08-09T14:16:51.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-09T14:16:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.621+0000 7fa6ce548700 1 Processor -- start 2023-08-09T14:16:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.621+0000 7fa6ce548700 1 -- start start 2023-08-09T14:16:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ce548700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7fa6c80cced0 0x7fa6c80c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ce548700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 0x7fa6c8163290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ce548700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c806c490 con 0x7fa6c81596f0 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ce548700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c806d110 con 0x7fa6c80cced0 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ce548700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80c9fd0 con 0x7fa6c80c9b40 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6c7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6c81596f0 0x7fa6c806bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58278/0 (socket says 172.21.15.5:58278) 2023-08-09T14:16:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6c7fff700 1 -- 172.21.15.5:0/2384759621 learned_addr learned my addr 172.21.15.5:0/2384759621 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/2384759621 >> v2:172.21.15.101:3300/0 conn(0x7fa6c80cced0 0x7fa6c80c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.622+0000 7fa6ccae5700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 0x7fa6c8163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864242714 0 0) 0x7fa6c806c490 con 0x7fa6c81596f0 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b00035b0 con 0x7fa6c81596f0 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c77fe700 1 -- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 msgr2=0x7fa6c8163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 0x7fa6c8163290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c77fe700 1 -- 172.21.15.5:0/2384759621 >> v1:172.21.15.5:6789/0 conn(0x7fa6c81596f0 legacy=0x7fa6c806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660031863 0 0) 0x7fa6b00035b0 con 0x7fa6c81596f0 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c77fe700 1 -- 172.21.15.5:0/2384759621 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c806c770 con 0x7fa6c80cced0 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6ccae5700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 0x7fa6c8163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80cced0 0x7fa6c80c9600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009840 tx=0x7fa6b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e4721b6e6d22dac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc001670 con 0x7fa6c80cced0 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b8004030 con 0x7fa6c80cced0 2023-08-09T14:16:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.623+0000 7fa6c6ffd700 1 -- 172.21.15.5:0/2384759621 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80043c0 con 0x7fa6c80cced0 2023-08-09T14:16:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 -- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80cced0 msgr2=0x7fa6c80c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80cced0 0x7fa6c80c9600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009840 tx=0x7fa6b8009b50 comp rx=0 tx=0).stop 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 -- 172.21.15.5:0/2384759621 shutdown_connections 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c80c9b40 0x7fa6c8163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 --2- 172.21.15.5:0/2384759621 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80cced0 0x7fa6c80c9600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 -- 172.21.15.5:0/2384759621 >> 172.21.15.5:0/2384759621 conn(0x7fa6c80b0850 msgr2=0x7fa6c80b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 -- 172.21.15.5:0/2384759621 shutdown_connections 2023-08-09T14:16:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.624+0000 7fa6ce548700 1 -- 172.21.15.5:0/2384759621 wait complete. 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.625+0000 7fa6ce548700 1 Processor -- start 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 -- start start 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80c9b40 0x7fa6c814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81596f0 0x7fa6c8149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80c83b0 con 0x7fa6c80cced0 2023-08-09T14:16:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80c7310 con 0x7fa6c80c9b40 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6ce548700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80c75f0 con 0x7fa6c81596f0 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44870/0 (socket says 172.21.15.5:44870) 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.626+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1109377948 learned_addr learned my addr 172.21.15.5:0/1109377948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80c9b40 0x7fa6c814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6ccae5700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81596f0 0x7fa6c8149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81596f0 msgr2=0x7fa6c8149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81596f0 0x7fa6c8149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80c9b40 msgr2=0x7fa6c814cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80c9b40 0x7fa6c814cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 -- 172.21.15.5:0/1109377948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0009a70 con 0x7fa6c80cced0 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c77fe700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80090b0 tx=0x7fa6b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8003e20 con 0x7fa6c80cced0 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b801f070 con 0x7fa6c80cced0 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8011870 con 0x7fa6c80cced0 2023-08-09T14:16:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b80094a0 con 0x7fa6c80cced0 2023-08-09T14:16:51.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.627+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c80c7bb0 con 0x7fa6c80cced0 2023-08-09T14:16:51.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.628+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8074600 con 0x7fa6c80cced0 2023-08-09T14:16:51.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.628+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6b80119d0 con 0x7fa6c80cced0 2023-08-09T14:16:51.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.629+0000 7fa6c4ff9700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 0x7fa6b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.629+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6b8021070 con 0x7fa6c80cced0 2023-08-09T14:16:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.629+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 0x7fa6b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.629+0000 7fa6c7fff700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 0x7fa6b406c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001eb0 tx=0x7fa6bc001c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.633+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa6b8055600 con 0x7fa6c80cced0 2023-08-09T14:16:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.921+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa6c8158100 con 0x7fa6c80cced0 2023-08-09T14:16:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.921+0000 7fa6c4ff9700 1 -- 172.21.15.5:0/1109377948 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1272 (secure 0 0 0) 0x7fa6b802b020 con 0x7fa6c80cced0 2023-08-09T14:16:51.923 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:16:51.923 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","modified":"2023-08-09T14:14:35.479622Z","created":"2023-08-09T14:14:35.479622Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:3300","nonce":0},{"type":"v1","addr":"172.21.15.101:6789","nonce":0}]},"addr":"172.21.15.101:6789/0","public_addr":"172.21.15.101:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:3301","nonce":0},{"type":"v1","addr":"172.21.15.101:6790","nonce":0}]},"addr":"172.21.15.101:6790/0","public_addr":"172.21.15.101:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-09T14:16:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 msgr2=0x7fa6b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 0x7fa6b406c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001eb0 tx=0x7fa6bc001c40 comp rx=0 tx=0).stop 2023-08-09T14:16:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 msgr2=0x7fa6c8150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80090b0 tx=0x7fa6b8004750 comp rx=0 tx=0).stop 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 shutdown_connections 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fa6b406a0e0 0x7fa6b406c5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fa6c81596f0 0x7fa6c8149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fa6c80c9b40 0x7fa6c814cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 --2- 172.21.15.5:0/1109377948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c80cced0 0x7fa6c8150800 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 >> 172.21.15.5:0/1109377948 conn(0x7fa6c80b0850 msgr2=0x7fa6c806fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.923+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 shutdown_connections 2023-08-09T14:16:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:51.924+0000 7fa6ce548700 1 -- 172.21.15.5:0/1109377948 wait complete. 2023-08-09T14:16:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:dumped monmap epoch 1 2023-08-09T14:16:51.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-08-09T14:16:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.062+0000 7f2765e6f700 1 Processor -- start 2023-08-09T14:16:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.062+0000 7f2765e6f700 1 -- start start 2023-08-09T14:16:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f2765e6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f276015d400 0x7f27600cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f2765e6f700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f276006a640 0x7f276006d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f2765e6f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276006e850 con 0x7f276006a1c0 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f2765e6f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276006aad0 con 0x7f276015d400 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f2765e6f700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600cf7b0 con 0x7f276006a640 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f276015d400 0x7f27600cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f276015d400 0x7f27600cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44876/0 (socket says 172.21.15.5:44876) 2023-08-09T14:16:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 -- 172.21.15.5:0/2682382917 learned_addr learned my addr 172.21.15.5:0/2682382917 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275ffff700 1 --2- 172.21.15.5:0/2682382917 >> v2:172.21.15.101:3300/0 conn(0x7f276006a640 0x7f276006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 -- 172.21.15.5:0/2682382917 >> v2:172.21.15.101:3300/0 conn(0x7f276006a640 msgr2=0x7f276006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 --2- 172.21.15.5:0/2682382917 >> v2:172.21.15.101:3300/0 conn(0x7f276006a640 0x7f276006d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 -- 172.21.15.5:0/2682382917 >> v1:172.21.15.101:6789/0 conn(0x7f276006a1c0 legacy=0x7f276006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:16:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 -- 172.21.15.5:0/2682382917 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600cfa90 con 0x7f276015d400 2023-08-09T14:16:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.063+0000 7f275f7fe700 1 --2- 172.21.15.5:0/2682382917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600cd940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27600ae9f0 tx=0x7f2750009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddca949ac6d51de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f275e7fc700 1 -- 172.21.15.5:0/2682382917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750004230 con 0x7f276015d400 2023-08-09T14:16:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f275e7fc700 1 -- 172.21.15.5:0/2682382917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750004390 con 0x7f276015d400 2023-08-09T14:16:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f275e7fc700 1 -- 172.21.15.5:0/2682382917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500036a0 con 0x7f276015d400 2023-08-09T14:16:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 -- 172.21.15.5:0/2682382917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 msgr2=0x7f27600cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 --2- 172.21.15.5:0/2682382917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600cd940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27600ae9f0 tx=0x7f2750009bd0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 -- 172.21.15.5:0/2682382917 shutdown_connections 2023-08-09T14:16:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 --2- 172.21.15.5:0/2682382917 >> v2:172.21.15.101:3300/0 conn(0x7f276006a640 0x7f276006d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 --2- 172.21.15.5:0/2682382917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600cd940 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 -- 172.21.15.5:0/2682382917 >> 172.21.15.5:0/2682382917 conn(0x7f27600b1900 msgr2=0x7f27600b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 -- 172.21.15.5:0/2682382917 shutdown_connections 2023-08-09T14:16:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.064+0000 7f2765e6f700 1 -- 172.21.15.5:0/2682382917 wait complete. 2023-08-09T14:16:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.065+0000 7f2765e6f700 1 Processor -- start 2023-08-09T14:16:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 -- start start 2023-08-09T14:16:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f276006a1c0 0x7f2760151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f276006a640 0x7f27600c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2760161cc0 con 0x7f276015d400 2023-08-09T14:16:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2760160c20 con 0x7f276006a1c0 2023-08-09T14:16:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.066+0000 7f2765e6f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2760160f00 con 0x7f276006a640 2023-08-09T14:16:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44886/0 (socket says 172.21.15.5:44886) 2023-08-09T14:16:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 -- 172.21.15.5:0/3526845359 learned_addr learned my addr 172.21.15.5:0/3526845359 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:16:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275f7fe700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f276006a1c0 0x7f2760151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275effd700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f276006a640 0x7f27600c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 -- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f276006a640 msgr2=0x7f27600c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f276006a640 0x7f27600c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 -- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f276006a1c0 msgr2=0x7f2760151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f276006a1c0 0x7f2760151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 -- 172.21.15.5:0/3526845359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750009550 con 0x7f276015d400 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f275ffff700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2758007e40 tx=0x7f275800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275800ede0 con 0x7f276015d400 2023-08-09T14:16:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758014420 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27601611e0 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580147d0 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.067+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27601617a0 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.068+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2760160970 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.069+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2758014930 con 0x7f276015d400 2023-08-09T14:16:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.069+0000 7f2757fff700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 0x7f274006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:16:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.069+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2758088ce0 con 0x7f276015d400 2023-08-09T14:16:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.069+0000 7f275f7fe700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 0x7f274006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:16:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.070+0000 7f275f7fe700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 0x7f274006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2750009130 tx=0x7f2750008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:16:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.074+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2758057e60 con 0x7f276015d400 2023-08-09T14:16:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.357+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f2760074600 con 0x7f276015d400 2023-08-09T14:16:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.357+0000 7f2757fff700 1 -- 172.21.15.5:0/3526845359 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f27580579f0 con 0x7f276015d400 2023-08-09T14:16:52.359 INFO:teuthology.orchestra.run.smithi005.stdout:[client.admin] 2023-08-09T14:16:52.359 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 msgr2=0x7f274006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 0x7f274006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2750009130 tx=0x7f2750008030 comp rx=0 tx=0).stop 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 msgr2=0x7f27600ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2758007e40 tx=0x7f275800e3c0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 shutdown_connections 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f274006a0e0 0x7f274006c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276015d400 0x7f27600ada30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f276006a1c0 0x7f2760151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 --2- 172.21.15.5:0/3526845359 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f276006a640 0x7f27600c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:16:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 >> 172.21.15.5:0/3526845359 conn(0x7f27600b1900 msgr2=0x7f276015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:16:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 shutdown_connections 2023-08-09T14:16:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:16:52.359+0000 7f2765e6f700 1 -- 172.21.15.5:0/3526845359 wait complete. 2023-08-09T14:16:52.373 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:52.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/tmp/tmp.cj6W3QcazExfstests-dev/local.config 2023-08-09T14:16:52.400 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.5:6789:/test export TEST_DIR=/tmp/tmp.ZQC68Dfhh8test export SCRATCH_DEV=172.21.15.5:6789:/scratch export SCRATCH_MNT=/tmp/tmp.rWxkiyh4p5scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ==" 2023-08-09T14:16:52.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:16:52.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/tmp/tmp.cj6W3QcazExfstests-dev/ceph.exclude 2023-08-09T14:16:52.468 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo make) 2023-08-09T14:16:52.549 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize -cfi 2023-08-09T14:16:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-09T14:16:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file './config.guess' 2023-08-09T14:16:52.900 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file './config.sub' 2023-08-09T14:16:52.904 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file './install-sh' 2023-08-09T14:16:52.908 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file './ltmain.sh' 2023-08-09T14:16:52.930 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-09T14:16:52.930 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-09T14:16:52.934 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-09T14:16:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-09T14:16:52.943 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-09T14:16:52.948 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-09T14:16:52.954 INFO:teuthology.orchestra.run.smithi005.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-09T14:16:52.955 INFO:teuthology.orchestra.run.smithi005.stdout:cp include/install-sh . 2023-08-09T14:16:52.956 INFO:teuthology.orchestra.run.smithi005.stdout:aclocal -I m4 2023-08-09T14:16:54.128 INFO:teuthology.orchestra.run.smithi005.stdout:autoheader 2023-08-09T14:16:54.452 INFO:teuthology.orchestra.run.smithi005.stdout:autoconf 2023-08-09T14:16:54.618 INFO:teuthology.orchestra.run.smithi005.stdout:./configure \ 2023-08-09T14:16:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: --libexecdir=/usr/lib \ 2023-08-09T14:16:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: --exec_prefix=/var/lib 2023-08-09T14:16:55.068 INFO:teuthology.orchestra.run.smithi005.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-09T14:16:55.068 INFO:teuthology.orchestra.run.smithi005.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-09T14:16:55.069 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to print strings... printf 2023-08-09T14:16:55.070 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gcc... gcc 2023-08-09T14:16:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether the C compiler works... yes 2023-08-09T14:16:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:checking for C compiler default output file name... a.out 2023-08-09T14:16:55.239 INFO:teuthology.orchestra.run.smithi005.stdout:checking for suffix of executables... 2023-08-09T14:16:55.286 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether we are cross compiling... no 2023-08-09T14:16:55.304 INFO:teuthology.orchestra.run.smithi005.stdout:checking for suffix of object files... o 2023-08-09T14:16:55.320 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether we are using the GNU C compiler... yes 2023-08-09T14:16:55.337 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether gcc accepts -g... yes 2023-08-09T14:16:55.364 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-09T14:16:55.367 INFO:teuthology.orchestra.run.smithi005.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-09T14:16:55.369 INFO:teuthology.orchestra.run.smithi005.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-09T14:16:55.370 INFO:teuthology.orchestra.run.smithi005.stdout:checking for egrep... /bin/grep -E 2023-08-09T14:16:55.371 INFO:teuthology.orchestra.run.smithi005.stdout:checking for fgrep... /bin/grep -F 2023-08-09T14:16:55.374 INFO:teuthology.orchestra.run.smithi005.stdout:checking for ld used by gcc... /bin/ld 2023-08-09T14:16:55.376 INFO:teuthology.orchestra.run.smithi005.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-09T14:16:55.403 INFO:teuthology.orchestra.run.smithi005.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-09T14:16:55.420 INFO:teuthology.orchestra.run.smithi005.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-09T14:16:55.420 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether ln -s works... yes 2023-08-09T14:16:55.437 INFO:teuthology.orchestra.run.smithi005.stdout:checking the maximum length of command line arguments... 1572864 2023-08-09T14:16:55.439 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-09T14:16:55.439 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-09T14:16:55.440 INFO:teuthology.orchestra.run.smithi005.stdout:checking for /bin/ld option to reload object files... -r 2023-08-09T14:16:55.440 INFO:teuthology.orchestra.run.smithi005.stdout:checking for objdump... objdump 2023-08-09T14:16:55.441 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to recognize dependent libraries... pass_all 2023-08-09T14:16:55.441 INFO:teuthology.orchestra.run.smithi005.stdout:checking for dlltool... no 2023-08-09T14:16:55.441 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-09T14:16:55.442 INFO:teuthology.orchestra.run.smithi005.stdout:checking for ar... ar 2023-08-09T14:16:55.472 INFO:teuthology.orchestra.run.smithi005.stdout:checking for archiver @FILE support... @ 2023-08-09T14:16:55.472 INFO:teuthology.orchestra.run.smithi005.stdout:checking for strip... strip 2023-08-09T14:16:55.473 INFO:teuthology.orchestra.run.smithi005.stdout:checking for ranlib... ranlib 2023-08-09T14:16:55.473 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gawk... gawk 2023-08-09T14:16:55.524 INFO:teuthology.orchestra.run.smithi005.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-09T14:16:55.525 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sysroot... no 2023-08-09T14:16:55.528 INFO:teuthology.orchestra.run.smithi005.stdout:checking for a working dd... /bin/dd 2023-08-09T14:16:55.531 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-09T14:16:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:checking for mt... no 2023-08-09T14:16:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:checking if : is a manifest tool... no 2023-08-09T14:16:55.569 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to run the C preprocessor... gcc -E 2023-08-09T14:16:55.701 INFO:teuthology.orchestra.run.smithi005.stdout:checking for ANSI C header files... yes 2023-08-09T14:16:55.721 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/types.h... yes 2023-08-09T14:16:55.745 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/stat.h... yes 2023-08-09T14:16:55.768 INFO:teuthology.orchestra.run.smithi005.stdout:checking for stdlib.h... yes 2023-08-09T14:16:55.793 INFO:teuthology.orchestra.run.smithi005.stdout:checking for string.h... yes 2023-08-09T14:16:55.818 INFO:teuthology.orchestra.run.smithi005.stdout:checking for memory.h... yes 2023-08-09T14:16:55.843 INFO:teuthology.orchestra.run.smithi005.stdout:checking for strings.h... yes 2023-08-09T14:16:55.869 INFO:teuthology.orchestra.run.smithi005.stdout:checking for inttypes.h... yes 2023-08-09T14:16:55.894 INFO:teuthology.orchestra.run.smithi005.stdout:checking for stdint.h... yes 2023-08-09T14:16:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:checking for unistd.h... yes 2023-08-09T14:16:55.965 INFO:teuthology.orchestra.run.smithi005.stdout:checking for dlfcn.h... yes 2023-08-09T14:16:55.968 INFO:teuthology.orchestra.run.smithi005.stdout:checking for objdir... .libs 2023-08-09T14:16:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-09T14:16:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-09T14:16:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-09T14:16:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:checking if gcc static flag -static works... no 2023-08-09T14:16:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:checking if gcc supports -c -o file.o... yes 2023-08-09T14:16:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-09T14:16:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-09T14:16:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether -lc should be explicitly linked in... no 2023-08-09T14:16:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-09T14:16:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:checking how to hardcode library paths into programs... immediate 2023-08-09T14:16:56.180 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether stripping libraries is possible... yes 2023-08-09T14:16:56.180 INFO:teuthology.orchestra.run.smithi005.stdout:checking if libtool supports shared libraries... yes 2023-08-09T14:16:56.180 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether to build shared libraries... yes 2023-08-09T14:16:56.181 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether to build static libraries... yes 2023-08-09T14:16:56.185 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gcc... (cached) gcc 2023-08-09T14:16:56.200 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-09T14:16:56.201 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-09T14:16:56.201 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-09T14:16:56.201 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gmake... /usr/bin/gmake 2023-08-09T14:16:56.201 INFO:teuthology.orchestra.run.smithi005.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-08-09T14:16:56.202 INFO:teuthology.orchestra.run.smithi005.stdout:checking for tar... /bin/tar 2023-08-09T14:16:56.202 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gzip... /bin/gzip 2023-08-09T14:16:56.208 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether gcc -MM is supported... yes 2023-08-09T14:16:56.209 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sort... /bin/sort 2023-08-09T14:16:56.209 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether ln -s works... yes 2023-08-09T14:16:56.210 INFO:teuthology.orchestra.run.smithi005.stdout:checking for rpm... /bin/rpm 2023-08-09T14:16:56.213 INFO:teuthology.orchestra.run.smithi005.stdout:checking for rpmbuild... no 2023-08-09T14:16:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:checking assert.h usability... yes 2023-08-09T14:16:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:checking assert.h presence... yes 2023-08-09T14:16:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:checking for assert.h... yes 2023-08-09T14:16:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:checking bstring.h usability... no 2023-08-09T14:16:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:checking bstring.h presence... no 2023-08-09T14:16:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:checking for bstring.h... no 2023-08-09T14:16:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:checking libgen.h usability... yes 2023-08-09T14:16:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:checking libgen.h presence... yes 2023-08-09T14:16:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:checking for libgen.h... yes 2023-08-09T14:16:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:checking dirent.h usability... yes 2023-08-09T14:16:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:checking dirent.h presence... yes 2023-08-09T14:16:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:checking for dirent.h... yes 2023-08-09T14:16:56.397 INFO:teuthology.orchestra.run.smithi005.stdout:checking errno.h usability... yes 2023-08-09T14:16:56.404 INFO:teuthology.orchestra.run.smithi005.stdout:checking errno.h presence... yes 2023-08-09T14:16:56.404 INFO:teuthology.orchestra.run.smithi005.stdout:checking for errno.h... yes 2023-08-09T14:16:56.432 INFO:teuthology.orchestra.run.smithi005.stdout:checking malloc.h usability... yes 2023-08-09T14:16:56.440 INFO:teuthology.orchestra.run.smithi005.stdout:checking malloc.h presence... yes 2023-08-09T14:16:56.441 INFO:teuthology.orchestra.run.smithi005.stdout:checking for malloc.h... yes 2023-08-09T14:16:56.466 INFO:teuthology.orchestra.run.smithi005.stdout:checking uuid.h usability... no 2023-08-09T14:16:56.476 INFO:teuthology.orchestra.run.smithi005.stdout:checking uuid.h presence... no 2023-08-09T14:16:56.476 INFO:teuthology.orchestra.run.smithi005.stdout:checking for uuid.h... no 2023-08-09T14:16:56.502 INFO:teuthology.orchestra.run.smithi005.stdout:checking uuid/uuid.h usability... yes 2023-08-09T14:16:56.511 INFO:teuthology.orchestra.run.smithi005.stdout:checking uuid/uuid.h presence... yes 2023-08-09T14:16:56.511 INFO:teuthology.orchestra.run.smithi005.stdout:checking for uuid/uuid.h... yes 2023-08-09T14:16:56.537 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/uuid.h usability... no 2023-08-09T14:16:56.547 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/uuid.h presence... no 2023-08-09T14:16:56.547 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/uuid.h... no 2023-08-09T14:16:56.572 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/file.h usability... yes 2023-08-09T14:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/file.h presence... yes 2023-08-09T14:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/file.h... yes 2023-08-09T14:16:56.608 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fcntl.h usability... yes 2023-08-09T14:16:56.615 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fcntl.h presence... yes 2023-08-09T14:16:56.616 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/fcntl.h... yes 2023-08-09T14:16:56.641 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/syssgi.h usability... no 2023-08-09T14:16:56.651 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/syssgi.h presence... no 2023-08-09T14:16:56.651 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/syssgi.h... no 2023-08-09T14:16:56.689 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/param.h usability... yes 2023-08-09T14:16:56.699 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/param.h presence... yes 2023-08-09T14:16:56.700 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/param.h... yes 2023-08-09T14:16:56.705 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/stat.h... (cached) yes 2023-08-09T14:16:56.733 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/statvfs.h usability... yes 2023-08-09T14:16:56.740 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/statvfs.h presence... yes 2023-08-09T14:16:56.741 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/statvfs.h... yes 2023-08-09T14:16:56.768 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/time.h usability... yes 2023-08-09T14:16:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/time.h presence... yes 2023-08-09T14:16:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/time.h... yes 2023-08-09T14:16:56.822 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/ioctl.h usability... yes 2023-08-09T14:16:56.830 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/ioctl.h presence... yes 2023-08-09T14:16:56.831 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/ioctl.h... yes 2023-08-09T14:16:56.860 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/wait.h usability... yes 2023-08-09T14:16:56.868 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/wait.h presence... yes 2023-08-09T14:16:56.869 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/wait.h... yes 2023-08-09T14:16:56.874 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/types.h... (cached) yes 2023-08-09T14:16:56.878 INFO:teuthology.orchestra.run.smithi005.stdout:checking for strings.h... (cached) yes 2023-08-09T14:16:56.905 INFO:teuthology.orchestra.run.smithi005.stdout:checking err.h usability... yes 2023-08-09T14:16:56.912 INFO:teuthology.orchestra.run.smithi005.stdout:checking err.h presence... yes 2023-08-09T14:16:56.913 INFO:teuthology.orchestra.run.smithi005.stdout:checking for err.h... yes 2023-08-09T14:16:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/falloc.h usability... yes 2023-08-09T14:16:56.948 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/falloc.h presence... yes 2023-08-09T14:16:56.949 INFO:teuthology.orchestra.run.smithi005.stdout:checking for linux/falloc.h... yes 2023-08-09T14:16:56.975 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-09T14:16:56.984 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-09T14:16:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-09T14:16:57.008 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-09T14:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-09T14:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-09T14:16:57.042 INFO:teuthology.orchestra.run.smithi005.stdout:checking xfs/platform_defs.h usability... no 2023-08-09T14:16:57.051 INFO:teuthology.orchestra.run.smithi005.stdout:checking xfs/platform_defs.h presence... no 2023-08-09T14:16:57.051 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/platform_defs.h... no 2023-08-09T14:16:57.074 INFO:teuthology.orchestra.run.smithi005.stdout:checking btrfs/ioctl.h usability... no 2023-08-09T14:16:57.084 INFO:teuthology.orchestra.run.smithi005.stdout:checking btrfs/ioctl.h presence... no 2023-08-09T14:16:57.084 INFO:teuthology.orchestra.run.smithi005.stdout:checking for btrfs/ioctl.h... no 2023-08-09T14:16:57.107 INFO:teuthology.orchestra.run.smithi005.stdout:checking cifs/ioctl.h usability... no 2023-08-09T14:16:57.117 INFO:teuthology.orchestra.run.smithi005.stdout:checking cifs/ioctl.h presence... no 2023-08-09T14:16:57.117 INFO:teuthology.orchestra.run.smithi005.stdout:checking for cifs/ioctl.h... no 2023-08-09T14:16:57.143 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/mman.h usability... yes 2023-08-09T14:16:57.150 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/mman.h presence... yes 2023-08-09T14:16:57.150 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/mman.h... yes 2023-08-09T14:16:57.165 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/xfs_log_format.h... no 2023-08-09T14:16:57.200 INFO:teuthology.orchestra.run.smithi005.stdout:checking for uuid_compare... no 2023-08-09T14:16:57.231 INFO:teuthology.orchestra.run.smithi005.stdout:checking for uuid_compare in -luuid... yes 2023-08-09T14:16:57.289 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/xfs.h... yes 2023-08-09T14:16:57.302 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/libxfs.h... no 2023-08-09T14:16:57.317 INFO:teuthology.orchestra.run.smithi005.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-09T14:16:57.345 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/xqm.h... yes 2023-08-09T14:16:57.391 INFO:teuthology.orchestra.run.smithi005.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-09T14:16:57.414 INFO:teuthology.orchestra.run.smithi005.stdout:checking xfs/handle.h usability... yes 2023-08-09T14:16:57.421 INFO:teuthology.orchestra.run.smithi005.stdout:checking xfs/handle.h presence... yes 2023-08-09T14:16:57.421 INFO:teuthology.orchestra.run.smithi005.stdout:checking for xfs/handle.h... yes 2023-08-09T14:16:57.456 INFO:teuthology.orchestra.run.smithi005.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-09T14:16:57.493 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/acl.h usability... yes 2023-08-09T14:16:57.501 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/acl.h presence... yes 2023-08-09T14:16:57.501 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/acl.h... yes 2023-08-09T14:16:57.532 INFO:teuthology.orchestra.run.smithi005.stdout:checking acl/libacl.h usability... yes 2023-08-09T14:16:57.540 INFO:teuthology.orchestra.run.smithi005.stdout:checking acl/libacl.h presence... yes 2023-08-09T14:16:57.540 INFO:teuthology.orchestra.run.smithi005.stdout:checking for acl/libacl.h... yes 2023-08-09T14:16:57.572 INFO:teuthology.orchestra.run.smithi005.stdout:checking for acl_init in -lacl... yes 2023-08-09T14:16:57.595 INFO:teuthology.orchestra.run.smithi005.stdout:checking gdbm-ndbm.h usability... no 2023-08-09T14:16:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:checking gdbm-ndbm.h presence... no 2023-08-09T14:16:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gdbm-ndbm.h... no 2023-08-09T14:16:57.626 INFO:teuthology.orchestra.run.smithi005.stdout:checking gdbm/ndbm.h usability... no 2023-08-09T14:16:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:checking gdbm/ndbm.h presence... no 2023-08-09T14:16:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:checking for gdbm/ndbm.h... no 2023-08-09T14:16:57.657 INFO:teuthology.orchestra.run.smithi005.stdout:checking ndbm.h usability... no 2023-08-09T14:16:57.666 INFO:teuthology.orchestra.run.smithi005.stdout:checking ndbm.h presence... no 2023-08-09T14:16:57.667 INFO:teuthology.orchestra.run.smithi005.stdout:checking for ndbm.h... no 2023-08-09T14:16:57.692 INFO:teuthology.orchestra.run.smithi005.stdout:checking libaio.h usability... yes 2023-08-09T14:16:57.702 INFO:teuthology.orchestra.run.smithi005.stdout:checking libaio.h presence... yes 2023-08-09T14:16:57.703 INFO:teuthology.orchestra.run.smithi005.stdout:checking for libaio.h... yes 2023-08-09T14:16:57.725 INFO:teuthology.orchestra.run.smithi005.stdout:checking liburing.h usability... no 2023-08-09T14:16:57.734 INFO:teuthology.orchestra.run.smithi005.stdout:checking liburing.h presence... no 2023-08-09T14:16:57.734 INFO:teuthology.orchestra.run.smithi005.stdout:checking for liburing.h... no 2023-08-09T14:16:57.756 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/capability.h usability... no 2023-08-09T14:16:57.766 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/capability.h presence... no 2023-08-09T14:16:57.766 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/capability.h... no 2023-08-09T14:16:57.789 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/fiemap.h usability... yes 2023-08-09T14:16:57.795 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/fiemap.h presence... yes 2023-08-09T14:16:57.796 INFO:teuthology.orchestra.run.smithi005.stdout:checking for linux/fiemap.h... yes 2023-08-09T14:16:57.828 INFO:teuthology.orchestra.run.smithi005.stdout:checking for fallocate... yes 2023-08-09T14:16:57.862 INFO:teuthology.orchestra.run.smithi005.stdout:checking for open_by_handle_at... yes 2023-08-09T14:16:57.885 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/prctl.h usability... yes 2023-08-09T14:16:57.893 INFO:teuthology.orchestra.run.smithi005.stdout:checking sys/prctl.h presence... yes 2023-08-09T14:16:57.893 INFO:teuthology.orchestra.run.smithi005.stdout:checking for sys/prctl.h... yes 2023-08-09T14:16:57.917 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/fs.h usability... yes 2023-08-09T14:16:57.924 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/fs.h presence... yes 2023-08-09T14:16:57.925 INFO:teuthology.orchestra.run.smithi005.stdout:checking for linux/fs.h... yes 2023-08-09T14:16:57.946 INFO:teuthology.orchestra.run.smithi005.stdout:checking btrfsutil.h usability... no 2023-08-09T14:16:57.956 INFO:teuthology.orchestra.run.smithi005.stdout:checking btrfsutil.h presence... no 2023-08-09T14:16:57.956 INFO:teuthology.orchestra.run.smithi005.stdout:checking for btrfsutil.h... no 2023-08-09T14:16:57.991 INFO:teuthology.orchestra.run.smithi005.stdout:checking for copy_file_range... yes 2023-08-09T14:16:58.027 INFO:teuthology.orchestra.run.smithi005.stdout:checking for SEEK_DATA... yes 2023-08-09T14:16:58.073 INFO:teuthology.orchestra.run.smithi005.stdout:checking for BMV_OF_SHARED... yes 2023-08-09T14:16:58.108 INFO:teuthology.orchestra.run.smithi005.stdout:checking for nftw... yes 2023-08-09T14:16:58.143 INFO:teuthology.orchestra.run.smithi005.stdout:checking for RLIMIT_NOFILE... yes 2023-08-09T14:16:58.160 INFO:teuthology.orchestra.run.smithi005.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-09T14:16:58.193 INFO:teuthology.orchestra.run.smithi005.stdout:checking for renameat2... yes 2023-08-09T14:16:58.226 INFO:teuthology.orchestra.run.smithi005.stdout:checking for reallocarray... yes 2023-08-09T14:16:58.239 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct mount_attr... no 2023-08-09T14:16:58.283 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-09T14:16:58.317 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-09T14:16:58.351 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-09T14:16:58.386 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-09T14:16:58.420 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-09T14:16:58.455 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-09T14:16:58.489 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-09T14:16:58.516 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/btrfs.h usability... yes 2023-08-09T14:16:58.523 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/btrfs.h presence... yes 2023-08-09T14:16:58.523 INFO:teuthology.orchestra.run.smithi005.stdout:checking for linux/btrfs.h... yes 2023-08-09T14:16:58.553 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-09T14:16:58.560 INFO:teuthology.orchestra.run.smithi005.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-09T14:16:58.560 INFO:teuthology.orchestra.run.smithi005.stdout:checking for linux/btrfs_tree.h... yes 2023-08-09T14:16:58.592 INFO:teuthology.orchestra.run.smithi005.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-08-09T14:16:58.608 INFO:teuthology.orchestra.run.smithi005.stdout:configure: creating ./config.status 2023-08-09T14:16:58.912 INFO:teuthology.orchestra.run.smithi005.stdout:config.status: creating include/builddefs 2023-08-09T14:16:58.923 INFO:teuthology.orchestra.run.smithi005.stdout:config.status: creating include/config.h 2023-08-09T14:16:58.931 INFO:teuthology.orchestra.run.smithi005.stdout:config.status: executing libtool commands 2023-08-09T14:16:58.969 INFO:teuthology.orchestra.run.smithi005.stdout:Building include 2023-08-09T14:16:58.972 INFO:teuthology.orchestra.run.smithi005.stdout:Building lib 2023-08-09T14:16:58.975 INFO:teuthology.orchestra.run.smithi005.stdout: [LTDEP] 2023-08-09T14:16:59.080 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dataascii.lo 2023-08-09T14:16:59.196 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] databin.lo 2023-08-09T14:16:59.337 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] datapid.lo 2023-08-09T14:16:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] file_lock.lo 2023-08-09T14:16:59.579 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] forker.lo 2023-08-09T14:16:59.708 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] pattern.lo 2023-08-09T14:16:59.825 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] open_flags.lo 2023-08-09T14:16:59.963 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] random_range.lo 2023-08-09T14:17:00.177 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] string_to_tokens.lo 2023-08-09T14:17:00.278 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] str_to_bytes.lo 2023-08-09T14:17:00.403 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] tlibio.lo 2023-08-09T14:17:00.622 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] write_log.lo 2023-08-09T14:17:00.851 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] random.lo 2023-08-09T14:17:00.961 INFO:teuthology.orchestra.run.smithi005.stdout: [LD] 2023-08-09T14:17:01.033 INFO:teuthology.orchestra.run.smithi005.stdout:Building ltp 2023-08-09T14:17:01.036 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:01.155 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] doio 2023-08-09T14:17:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fsstress 2023-08-09T14:17:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fsx 2023-08-09T14:17:03.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:17:03.700 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:17:03.830 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] growfiles 2023-08-09T14:17:04.308 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] iogen 2023-08-09T14:17:04.641 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-stress 2023-08-09T14:17:05.035 INFO:teuthology.orchestra.run.smithi005.stdout:Building src 2023-08-09T14:17:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:06.575 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:06.602 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:06.609 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: [DEP] 2023-08-09T14:17:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dirstress 2023-08-09T14:17:07.042 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fill 2023-08-09T14:17:07.187 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fill2 2023-08-09T14:17:07.401 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] getpagesize 2023-08-09T14:17:07.537 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] holes 2023-08-09T14:17:07.719 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] lstat64 2023-08-09T14:17:07.891 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] nametest 2023-08-09T14:17:08.116 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] permname 2023-08-09T14:17:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] randholes 2023-08-09T14:17:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] runas 2023-08-09T14:17:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] truncfile 2023-08-09T14:17:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] usemem 2023-08-09T14:17:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] mmapcat 2023-08-09T14:17:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] append_reader 2023-08-09T14:17:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] append_writer 2023-08-09T14:17:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dirperf 2023-08-09T14:17:09.636 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] metaperf 2023-08-09T14:17:09.875 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] devzero 2023-08-09T14:17:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] feature 2023-08-09T14:17:10.240 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] alloc 2023-08-09T14:17:10.437 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fault 2023-08-09T14:17:10.590 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fstest 2023-08-09T14:17:10.811 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_access_root 2023-08-09T14:17:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] godown 2023-08-09T14:17:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] resvtest 2023-08-09T14:17:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] writemod 2023-08-09T14:17:11.429 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] writev_on_pagefault 2023-08-09T14:17:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] makeextents 2023-08-09T14:17:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] itrash 2023-08-09T14:17:11.894 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] rename 2023-08-09T14:17:12.027 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] multi_open_unlink 2023-08-09T14:17:12.181 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] unwritten_sync 2023-08-09T14:17:12.350 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] genhashnames 2023-08-09T14:17:12.527 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_holes 2023-08-09T14:17:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_writev 2023-08-09T14:17:12.837 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_truncate_cmtime 2023-08-09T14:17:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dirhash_collide 2023-08-09T14:17:13.158 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_rename_overwrite 2023-08-09T14:17:13.292 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] holetest 2023-08-09T14:17:13.497 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_truncate_self 2023-08-09T14:17:13.631 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] af_unix 2023-08-09T14:17:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_stale_pmd 2023-08-09T14:17:13.920 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_cow_race 2023-08-09T14:17:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_fallocate 2023-08-09T14:17:14.218 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fsync-err 2023-08-09T14:17:14.392 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_write_ro 2023-08-09T14:17:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-09T14:17:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-09T14:17:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_ofd_locks 2023-08-09T14:17:15.021 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_collision 2023-08-09T14:17:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] mmap-write-concurrent 2023-08-09T14:17:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_get_file_time 2023-08-09T14:17:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_create_short_dirs 2023-08-09T14:17:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_create_long_dirs 2023-08-09T14:17:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_enospc 2023-08-09T14:17:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_writev_overlap 2023-08-09T14:17:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] checkpoint_journal 2023-08-09T14:17:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] mmap-rw-fault 2023-08-09T14:17:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] allocstale 2023-08-09T14:17:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_cow_memory_failure 2023-08-09T14:17:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fake-dump-rootino 2023-08-09T14:17:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dio-buf-fault 2023-08-09T14:17:17.081 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] xfsctl 2023-08-09T14:17:17.257 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] bstat 2023-08-09T14:17:17.447 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mtab 2023-08-09T14:17:17.621 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] getdevicesize 2023-08-09T14:17:17.755 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] preallo_rw_pattern_reader 2023-08-09T14:17:17.904 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] preallo_rw_pattern_writer 2023-08-09T14:17:18.053 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] ftrunc 2023-08-09T14:17:18.193 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] trunc 2023-08-09T14:17:18.394 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fs_perms 2023-08-09T14:17:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] testx 2023-08-09T14:17:18.674 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] looptest 2023-08-09T14:17:18.854 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] locktest 2023-08-09T14:17:19.142 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] unwritten_mmap 2023-08-09T14:17:19.295 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] bulkstat_unlink_test 2023-08-09T14:17:19.482 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] deduperace 2023-08-09T14:17:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] bulkstat_unlink_test_modified 2023-08-09T14:17:19.849 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_dir_offset 2023-08-09T14:17:19.991 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_futimens 2023-08-09T14:17:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_immutable 2023-08-09T14:17:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] stale_handle 2023-08-09T14:17:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] pwrite_mmap_blocked 2023-08-09T14:17:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_dir_offset2 2023-08-09T14:17:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] seek_sanity_test 2023-08-09T14:17:21.567 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] seek_copy_test 2023-08-09T14:17:21.733 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_readdir_1 2023-08-09T14:17:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_readdir_2 2023-08-09T14:17:22.016 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fsync-tester 2023-08-09T14:17:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] nsexec 2023-08-09T14:17:22.417 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] cloner 2023-08-09T14:17:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] renameat2 2023-08-09T14:17:22.740 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_getcwd 2023-08-09T14:17:22.889 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] e4compact 2023-08-09T14:17:23.078 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] test-nextquota 2023-08-09T14:17:23.237 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] punch-alternating 2023-08-09T14:17:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-09T14:17:23.556 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] listxattr 2023-08-09T14:17:23.696 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dio-interleaved 2023-08-09T14:17:23.847 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_dir_type 2023-08-09T14:17:24.052 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] dio-invalidate-cache 2023-08-09T14:17:24.239 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] stat_test 2023-08-09T14:17:24.516 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_encrypted_d_revalidate 2023-08-09T14:17:24.673 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] attr_replace_test 2023-08-09T14:17:24.826 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] swapon 2023-08-09T14:17:24.980 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] mkswap 2023-08-09T14:17:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_attr_corruption 2023-08-09T14:17:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_open_tmpfiles 2023-08-09T14:17:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fscrypt-crypt-util 2023-08-09T14:17:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] bulkstat_null_ocount 2023-08-09T14:17:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] splice-test 2023-08-09T14:17:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] chprojid_fail 2023-08-09T14:17:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] detached_mounts_propagation 2023-08-09T14:17:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] ext4_resize 2023-08-09T14:17:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_readdir_3 2023-08-09T14:17:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] splice2pipe 2023-08-09T14:17:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] uuid_ioctl 2023-08-09T14:17:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fiemap-tester 2023-08-09T14:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_stripealign 2023-08-09T14:17:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] open_by_handle 2023-08-09T14:17:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] t_mmap_dio 2023-08-09T14:17:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] xfsfind 2023-08-09T14:17:28.275 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] fssum 2023-08-09T14:17:28.680 INFO:teuthology.orchestra.run.smithi005.stdout:Building log-writes 2023-08-09T14:17:28.685 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] replay-log 2023-08-09T14:17:28.976 INFO:teuthology.orchestra.run.smithi005.stdout:Building perf 2023-08-09T14:17:28.980 INFO:teuthology.orchestra.run.smithi005.stdout:Building aio-dio-regress 2023-08-09T14:17:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-09T14:17:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-fcntl-race 2023-08-09T14:17:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-subblock-eof-read 2023-08-09T14:17:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-append-write-read-race 2023-08-09T14:17:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-invalidate-readahead 2023-08-09T14:17:29.773 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-write-verify 2023-08-09T14:17:29.956 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-09T14:17:30.087 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-last-ref-held-by-io 2023-08-09T14:17:30.254 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-cycle-write 2023-08-09T14:17:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-extend-stat 2023-08-09T14:17:30.590 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-09T14:17:30.720 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-hole-filling-race 2023-08-09T14:17:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-invalidate-failure 2023-08-09T14:17:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aiodio_sparse2 2023-08-09T14:17:31.227 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aiocp 2023-08-09T14:17:31.444 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-cow-race 2023-08-09T14:17:31.592 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] aio-dio-eof-race 2023-08-09T14:17:31.768 INFO:teuthology.orchestra.run.smithi005.stdout:Building vfs 2023-08-09T14:17:31.773 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] vfstest 2023-08-09T14:17:33.544 INFO:teuthology.orchestra.run.smithi005.stdout: [CC] mount-idmapped 2023-08-09T14:17:33.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:17:33.773 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:17:33.890 INFO:teuthology.orchestra.run.smithi005.stdout:Building m4 2023-08-09T14:17:33.893 INFO:teuthology.orchestra.run.smithi005.stdout:Building common 2023-08-09T14:17:33.896 INFO:teuthology.orchestra.run.smithi005.stdout:Building tests 2023-08-09T14:17:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:Building perf 2023-08-09T14:17:33.906 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/perf/group.list 2023-08-09T14:17:33.917 INFO:teuthology.orchestra.run.smithi005.stdout:Building ext4 2023-08-09T14:17:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ext4/group.list 2023-08-09T14:17:33.957 INFO:teuthology.orchestra.run.smithi005.stdout:Building ocfs2 2023-08-09T14:17:33.962 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ocfs2/group.list 2023-08-09T14:17:33.974 INFO:teuthology.orchestra.run.smithi005.stdout:Building overlay 2023-08-09T14:17:33.980 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/overlay/group.list 2023-08-09T14:17:34.016 INFO:teuthology.orchestra.run.smithi005.stdout:Building cifs 2023-08-09T14:17:34.021 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/cifs/group.list 2023-08-09T14:17:34.033 INFO:teuthology.orchestra.run.smithi005.stdout:Building generic 2023-08-09T14:17:34.039 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/generic/group.list 2023-08-09T14:17:34.134 INFO:teuthology.orchestra.run.smithi005.stdout:Building shared 2023-08-09T14:17:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/shared/group.list 2023-08-09T14:17:34.153 INFO:teuthology.orchestra.run.smithi005.stdout:Building nfs 2023-08-09T14:17:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/nfs/group.list 2023-08-09T14:17:34.171 INFO:teuthology.orchestra.run.smithi005.stdout:Building f2fs 2023-08-09T14:17:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/f2fs/group.list 2023-08-09T14:17:34.192 INFO:teuthology.orchestra.run.smithi005.stdout:Building udf 2023-08-09T14:17:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/udf/group.list 2023-08-09T14:17:34.207 INFO:teuthology.orchestra.run.smithi005.stdout:Building ceph 2023-08-09T14:17:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ceph/group.list 2023-08-09T14:17:34.226 INFO:teuthology.orchestra.run.smithi005.stdout:Building xfs 2023-08-09T14:17:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/xfs/group.list 2023-08-09T14:17:34.326 INFO:teuthology.orchestra.run.smithi005.stdout:Building btrfs 2023-08-09T14:17:34.332 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/btrfs/group.list 2023-08-09T14:17:34.388 INFO:teuthology.orchestra.run.smithi005.stdout:Building tmpfs 2023-08-09T14:17:34.393 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/tmpfs/group.list 2023-08-09T14:17:34.407 INFO:teuthology.orchestra.run.smithi005.stdout:Building selftest 2023-08-09T14:17:34.411 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/selftest/group.list 2023-08-09T14:17:34.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo make install) 2023-08-09T14:17:34.461 INFO:teuthology.orchestra.run.smithi005.stdout:Building include 2023-08-09T14:17:34.465 INFO:teuthology.orchestra.run.smithi005.stdout:Building lib 2023-08-09T14:17:34.468 INFO:teuthology.orchestra.run.smithi005.stdout:Building ltp 2023-08-09T14:17:34.472 INFO:teuthology.orchestra.run.smithi005.stdout:Building src 2023-08-09T14:17:34.506 INFO:teuthology.orchestra.run.smithi005.stdout:Building log-writes 2023-08-09T14:17:34.509 INFO:teuthology.orchestra.run.smithi005.stdout:Building perf 2023-08-09T14:17:34.512 INFO:teuthology.orchestra.run.smithi005.stdout:Building aio-dio-regress 2023-08-09T14:17:34.516 INFO:teuthology.orchestra.run.smithi005.stdout:Building vfs 2023-08-09T14:17:34.520 INFO:teuthology.orchestra.run.smithi005.stdout:Building m4 2023-08-09T14:17:34.523 INFO:teuthology.orchestra.run.smithi005.stdout:Building common 2023-08-09T14:17:34.527 INFO:teuthology.orchestra.run.smithi005.stdout:Building tests 2023-08-09T14:17:34.532 INFO:teuthology.orchestra.run.smithi005.stdout:Building perf 2023-08-09T14:17:34.537 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/perf/group.list 2023-08-09T14:17:34.548 INFO:teuthology.orchestra.run.smithi005.stdout:Building ext4 2023-08-09T14:17:34.553 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ext4/group.list 2023-08-09T14:17:34.587 INFO:teuthology.orchestra.run.smithi005.stdout:Building ocfs2 2023-08-09T14:17:34.592 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ocfs2/group.list 2023-08-09T14:17:34.604 INFO:teuthology.orchestra.run.smithi005.stdout:Building overlay 2023-08-09T14:17:34.609 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/overlay/group.list 2023-08-09T14:17:34.646 INFO:teuthology.orchestra.run.smithi005.stdout:Building cifs 2023-08-09T14:17:34.651 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/cifs/group.list 2023-08-09T14:17:34.662 INFO:teuthology.orchestra.run.smithi005.stdout:Building generic 2023-08-09T14:17:34.669 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/generic/group.list 2023-08-09T14:17:34.760 INFO:teuthology.orchestra.run.smithi005.stdout:Building shared 2023-08-09T14:17:34.765 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/shared/group.list 2023-08-09T14:17:34.781 INFO:teuthology.orchestra.run.smithi005.stdout:Building nfs 2023-08-09T14:17:34.786 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/nfs/group.list 2023-08-09T14:17:34.799 INFO:teuthology.orchestra.run.smithi005.stdout:Building f2fs 2023-08-09T14:17:34.804 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/f2fs/group.list 2023-08-09T14:17:34.820 INFO:teuthology.orchestra.run.smithi005.stdout:Building udf 2023-08-09T14:17:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/udf/group.list 2023-08-09T14:17:34.835 INFO:teuthology.orchestra.run.smithi005.stdout:Building ceph 2023-08-09T14:17:34.840 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/ceph/group.list 2023-08-09T14:17:34.854 INFO:teuthology.orchestra.run.smithi005.stdout:Building xfs 2023-08-09T14:17:34.860 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/xfs/group.list 2023-08-09T14:17:34.953 INFO:teuthology.orchestra.run.smithi005.stdout:Building btrfs 2023-08-09T14:17:34.959 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/btrfs/group.list 2023-08-09T14:17:35.015 INFO:teuthology.orchestra.run.smithi005.stdout:Building tmpfs 2023-08-09T14:17:35.020 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/tmpfs/group.list 2023-08-09T14:17:35.032 INFO:teuthology.orchestra.run.smithi005.stdout:Building selftest 2023-08-09T14:17:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: [GROUP] /tmp/tmp.cj6W3QcazExfstests-dev/tests/selftest/group.list 2023-08-09T14:17:35.048 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-09T14:17:35.050 INFO:teuthology.orchestra.run.smithi005.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-09T14:17:35.050 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-09T14:17:35.052 INFO:teuthology.orchestra.run.smithi005.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-09T14:17:35.052 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-09T14:17:35.054 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-09T14:17:35.063 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-09T14:17:35.141 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-09T14:17:35.150 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-09T14:17:35.166 INFO:teuthology.orchestra.run.smithi005.stdout:Building log-writes 2023-08-09T14:17:35.170 INFO:teuthology.orchestra.run.smithi005.stdout:Building perf 2023-08-09T14:17:35.173 INFO:teuthology.orchestra.run.smithi005.stdout:Building aio-dio-regress 2023-08-09T14:17:35.177 INFO:teuthology.orchestra.run.smithi005.stdout:Building vfs 2023-08-09T14:17:35.180 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake -C log-writes install 2023-08-09T14:17:35.182 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-09T14:17:35.191 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-09T14:17:35.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake -C perf install 2023-08-09T14:17:35.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-09T14:17:35.210 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-09T14:17:35.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-09T14:17:35.235 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-09T14:17:35.244 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-08-09T14:17:35.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake -C vfs install 2023-08-09T14:17:35.300 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-09T14:17:35.309 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-09T14:17:35.322 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-09T14:17:35.331 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-09T14:17:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-08-09T14:17:36.665 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-09T14:17:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-09T14:17:36.697 INFO:teuthology.orchestra.run.smithi005.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-09T14:17:36.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-09T14:17:36.699 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-09T14:17:36.708 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-09T14:17:36.845 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-09T14:17:36.846 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/btrfs/ install 2023-08-09T14:17:36.849 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-09T14:17:36.858 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 299 /var/lib/xfstests/tests/btrfs 2023-08-09T14:17:37.703 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-09T14:17:37.713 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 024.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 196.out 242.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 003.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 184.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 004.out 211.out 158.out 182.out 146.out 188.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 175.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 007.out 293.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 021.out 253.out 255.out 090.out 221.out 087.out 294.out 212.out 112.out 256.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out /var/lib/xfstests/tests/btrfs 2023-08-09T14:17:38.564 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/ceph/ install 2023-08-09T14:17:38.565 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-09T14:17:38.573 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-09T14:17:38.594 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-09T14:17:38.603 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-08-09T14:17:38.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/cifs/ install 2023-08-09T14:17:38.624 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-09T14:17:38.633 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-09T14:17:38.642 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-09T14:17:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-09T14:17:38.661 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/ext4/ install 2023-08-09T14:17:38.662 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-09T14:17:38.671 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-09T14:17:38.869 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-09T14:17:38.878 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-08-09T14:17:39.086 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/f2fs/ install 2023-08-09T14:17:39.087 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-09T14:17:39.096 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-09T14:17:39.108 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-09T14:17:39.117 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-09T14:17:39.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/generic/ install 2023-08-09T14:17:39.134 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-09T14:17:39.142 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-08-09T14:17:41.215 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-09T14:17:41.224 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out 476.out /var/lib/xfstests/tests/generic 2023-08-09T14:17:43.323 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/nfs/ install 2023-08-09T14:17:43.324 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-09T14:17:43.333 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-09T14:17:43.342 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-09T14:17:43.351 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-09T14:17:43.360 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/ocfs2/ install 2023-08-09T14:17:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-09T14:17:43.371 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-09T14:17:43.380 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-09T14:17:43.389 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-09T14:17:43.399 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/overlay/ install 2023-08-09T14:17:43.400 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-09T14:17:43.409 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-09T14:17:43.692 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-09T14:17:43.701 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-08-09T14:17:43.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/perf/ install 2023-08-09T14:17:43.986 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-09T14:17:43.996 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-09T14:17:44.004 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-09T14:17:44.013 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-09T14:17:44.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/selftest/ install 2023-08-09T14:17:44.024 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-09T14:17:44.033 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-09T14:17:44.056 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/shared/ install 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-09T14:17:44.201 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/tmpfs/ install 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-09T14:17:44.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/udf/ install 2023-08-09T14:17:44.203 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-09T14:17:44.203 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-09T14:17:44.203 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-09T14:17:44.203 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-09T14:17:44.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cj6W3QcazExfstests-dev/tests/xfs/ install 2023-08-09T14:17:44.216 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-09T14:17:44.225 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-09T14:17:46.202 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-09T14:17:46.212 INFO:teuthology.orchestra.run.smithi005.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-08-09T14:17:48.214 INFO:teuthology.orchestra.run.smithi005.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-09T14:17:48.223 INFO:teuthology.orchestra.run.smithi005.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-09T14:17:48.232 INFO:teuthology.orchestra.run.smithi005.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-09T14:17:48.244 INFO:teuthology.orchestra.run.smithi005.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-09T14:17:48.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:17:48.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec ls tests/generic) 2023-08-09T14:17:48.310 INFO:teuthology.orchestra.run.smithi005.stdout:001 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:001.out 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:002 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:002.out 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:003 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:003.out 2023-08-09T14:17:48.311 INFO:teuthology.orchestra.run.smithi005.stdout:004 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:004.out 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:005 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:005.out 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:006 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:006.out 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:007 2023-08-09T14:17:48.312 INFO:teuthology.orchestra.run.smithi005.stdout:007.out 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:008 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:008.out 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:009 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:009.out 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:010 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:010.out 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:011 2023-08-09T14:17:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:011.out 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:012 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:012.out 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:013 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:013.out 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:014 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:014.out 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:015 2023-08-09T14:17:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:015.out 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:016 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:016.out 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:017 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:017.out 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:018 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:018.out 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:019 2023-08-09T14:17:48.315 INFO:teuthology.orchestra.run.smithi005.stdout:019.out 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:020 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:020.out 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:021 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:021.out 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:022 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:022.out 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:023 2023-08-09T14:17:48.316 INFO:teuthology.orchestra.run.smithi005.stdout:023.out 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:024 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:024.out 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:025 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:025.out 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:026 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:026.out 2023-08-09T14:17:48.317 INFO:teuthology.orchestra.run.smithi005.stdout:027 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:027.out 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:028 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:028.out 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:029 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:029.out 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:030 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:030.out 2023-08-09T14:17:48.318 INFO:teuthology.orchestra.run.smithi005.stdout:031 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:031.out 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:032 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:032.out 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:033 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:033.out 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:034 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:034.out 2023-08-09T14:17:48.319 INFO:teuthology.orchestra.run.smithi005.stdout:035 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:035.cfg 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:035.out.default 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:035.out.nfs 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:036 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:036.out 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:037 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:037.out 2023-08-09T14:17:48.320 INFO:teuthology.orchestra.run.smithi005.stdout:038 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:038.out 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:039 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:039.out 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:040 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:040.out 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:041 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:041.out 2023-08-09T14:17:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:042 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:042.out 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:043 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:043.out 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:044 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:044.out 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:045 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:045.out 2023-08-09T14:17:48.322 INFO:teuthology.orchestra.run.smithi005.stdout:046 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:046.out 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:047 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:047.out 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:048 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:048.out 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:049 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:049.out 2023-08-09T14:17:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:050 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:050.cfg 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:050.out.default 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:050.out.nojournal 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:050.out.xfsquota 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:051 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:051.out 2023-08-09T14:17:48.324 INFO:teuthology.orchestra.run.smithi005.stdout:052 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:052.out 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:053 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:053.out 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:054 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:054.out 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:055 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:055.out 2023-08-09T14:17:48.325 INFO:teuthology.orchestra.run.smithi005.stdout:056 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:056.out 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:057 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:057.out 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:058 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:058.out 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:059 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:059.out 2023-08-09T14:17:48.326 INFO:teuthology.orchestra.run.smithi005.stdout:060 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:060.out 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:061 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:061.out 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:062 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:062.out 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:063 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:063.out 2023-08-09T14:17:48.327 INFO:teuthology.orchestra.run.smithi005.stdout:064 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:064.out 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:065 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:065.out 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:066 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:066.out 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:067 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:067.out 2023-08-09T14:17:48.328 INFO:teuthology.orchestra.run.smithi005.stdout:068 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:068.out 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:069 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:069.out 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:070 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:070.out 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:071 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:071.out 2023-08-09T14:17:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:072 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:072.out 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:073 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:073.out 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:074 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:074.out 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:075 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:075.out 2023-08-09T14:17:48.330 INFO:teuthology.orchestra.run.smithi005.stdout:076 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:076.out 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:077 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:077.out 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:078 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:078.out 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:079 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:079.out 2023-08-09T14:17:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:080 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:080.out 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:081 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:081.out 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:082 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:082.out 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:083 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:083.out 2023-08-09T14:17:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:084 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:084.out 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:085 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:085.out 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:086 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:086.out 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:087 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:087.out 2023-08-09T14:17:48.333 INFO:teuthology.orchestra.run.smithi005.stdout:088 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:088.out 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:089 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:089.out 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:090 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:090.out 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:091 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:091.out 2023-08-09T14:17:48.334 INFO:teuthology.orchestra.run.smithi005.stdout:092 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:092.out 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:093 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:093.out 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:094 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:094.out 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:095 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:095.out 2023-08-09T14:17:48.335 INFO:teuthology.orchestra.run.smithi005.stdout:096 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:096.out 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:097 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:097.out 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:098 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:098.out 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:099 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:099.out 2023-08-09T14:17:48.336 INFO:teuthology.orchestra.run.smithi005.stdout:100 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:100.out 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:101 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:101.out 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:102 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:102.out 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:103 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:103.out 2023-08-09T14:17:48.337 INFO:teuthology.orchestra.run.smithi005.stdout:104 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:104.out 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:105 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:105.out 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:106 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:106.out 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:107 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:107.out 2023-08-09T14:17:48.338 INFO:teuthology.orchestra.run.smithi005.stdout:108 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:108.out 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:109 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:109.out 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:110 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:110.out 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:111 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:111.out 2023-08-09T14:17:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:112 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:112.out 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:113 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:113.out 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:114 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:114.out 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:115 2023-08-09T14:17:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:115.out 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:116 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:116.out 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:117 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:117.out 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:118 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:118.out 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:119 2023-08-09T14:17:48.341 INFO:teuthology.orchestra.run.smithi005.stdout:119.out 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:120 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:120.out 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:121 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:121.out 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:122 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:122.out 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:123 2023-08-09T14:17:48.342 INFO:teuthology.orchestra.run.smithi005.stdout:123.out 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:124 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:124.out 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:125 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:125.out 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:126 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:126.out 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:127 2023-08-09T14:17:48.343 INFO:teuthology.orchestra.run.smithi005.stdout:127.out 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:128 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:128.out 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:129 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:129.out 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:130 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:130.out 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:131 2023-08-09T14:17:48.344 INFO:teuthology.orchestra.run.smithi005.stdout:131.out 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:132 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:132.out 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:133 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:133.out 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:134 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:134.out 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:135 2023-08-09T14:17:48.345 INFO:teuthology.orchestra.run.smithi005.stdout:135.out 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:136 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:136.out 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:137 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:137.out 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:138 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:138.out 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:139 2023-08-09T14:17:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:139.out 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:140 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:140.out 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:141 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:141.out 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:142 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:142.out 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:143 2023-08-09T14:17:48.347 INFO:teuthology.orchestra.run.smithi005.stdout:143.out 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:144 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:144.out 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:145 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:145.out 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:146 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:146.out 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:147 2023-08-09T14:17:48.348 INFO:teuthology.orchestra.run.smithi005.stdout:147.out 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:148 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:148.out 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:149 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:149.out 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:150 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:150.out 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:151 2023-08-09T14:17:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:151.out 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:152 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:152.out 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:153 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:153.out 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:154 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:154.out 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:155 2023-08-09T14:17:48.350 INFO:teuthology.orchestra.run.smithi005.stdout:155.out 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:156 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:156.out 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:157 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:157.out 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:158 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:158.out 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:159 2023-08-09T14:17:48.351 INFO:teuthology.orchestra.run.smithi005.stdout:159.out 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:160 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:160.out 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:161 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:161.out 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:162 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:162.out 2023-08-09T14:17:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:163 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:163.out 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:164 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:164.out 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:165 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:165.out 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:166 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:166.out 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:167 2023-08-09T14:17:48.353 INFO:teuthology.orchestra.run.smithi005.stdout:167.out 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:168 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:168.out 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:169 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:169.out 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:170 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:170.out 2023-08-09T14:17:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:171 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:171.out 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:172 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:172.out 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:173 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:173.out 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:174 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:174.out 2023-08-09T14:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout:175 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:175.out 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:176 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:176.out 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:177 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:177.out 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:178 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:178.out 2023-08-09T14:17:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:179 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:179.out 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:180 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:180.out 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:181 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:181.out 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:182 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:182.out 2023-08-09T14:17:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:183 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:183.out 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:184 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:184.out 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:185 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:185.out 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:186 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:186.out 2023-08-09T14:17:48.358 INFO:teuthology.orchestra.run.smithi005.stdout:187 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:187.out 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:188 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:188.out 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:189 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:189.out 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:190 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:190.out 2023-08-09T14:17:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:191 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:191.out 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:192 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:192.out 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:193 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:193.out 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:194 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:194.out 2023-08-09T14:17:48.360 INFO:teuthology.orchestra.run.smithi005.stdout:195 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:195.out 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:196 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:196.out 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:197 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:197.out 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:198 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:198.out 2023-08-09T14:17:48.361 INFO:teuthology.orchestra.run.smithi005.stdout:199 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:199.out 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:200 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:200.out 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:201 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:201.out 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:202 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:202.out 2023-08-09T14:17:48.362 INFO:teuthology.orchestra.run.smithi005.stdout:203 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:203.out 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:204 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:204.out 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:205 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:205.out 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:206 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:206.out 2023-08-09T14:17:48.363 INFO:teuthology.orchestra.run.smithi005.stdout:207 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:207.out 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:208 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:208.out 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:209 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:209.out 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:210 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:210.out 2023-08-09T14:17:48.364 INFO:teuthology.orchestra.run.smithi005.stdout:211 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:211.out 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:212 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:212.out 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:213 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:213.out 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:214 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:214.out 2023-08-09T14:17:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:215 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:215.out 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:216 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:216.out 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:217 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:217.out 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:218 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:218.out 2023-08-09T14:17:48.366 INFO:teuthology.orchestra.run.smithi005.stdout:219 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:219.out 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:220 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:220.out 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:221 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:221.out 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:222 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:222.out 2023-08-09T14:17:48.367 INFO:teuthology.orchestra.run.smithi005.stdout:223 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:223.out 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:224 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:224.out 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:225 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:225.out 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:226 2023-08-09T14:17:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:226.out 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:227 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:227.out 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:228 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:228.out 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:229 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:229.out 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:230 2023-08-09T14:17:48.369 INFO:teuthology.orchestra.run.smithi005.stdout:230.out 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:231 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:231.out 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:232 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:232.out 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:233 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:233.out 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:234 2023-08-09T14:17:48.370 INFO:teuthology.orchestra.run.smithi005.stdout:234.out 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:235 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:235.out 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:236 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:236.out 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:237 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:237.out 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:238 2023-08-09T14:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:238.out 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:239 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:239.out 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:240 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:240.out 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:241 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:241.out 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:242 2023-08-09T14:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout:242.out 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:243 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:243.out 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:244 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:244.out 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:245 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:245.out 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:246 2023-08-09T14:17:48.373 INFO:teuthology.orchestra.run.smithi005.stdout:246.out 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:247 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:247.out 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:248 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:248.out 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:249 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:249.out 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:250 2023-08-09T14:17:48.374 INFO:teuthology.orchestra.run.smithi005.stdout:250.out 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:251 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:251.out 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:252 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:252.out 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:253 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:253.out 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:254 2023-08-09T14:17:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:254.out 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:255 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:255.out 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:256 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:256.out 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:257 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:257.out 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:258 2023-08-09T14:17:48.376 INFO:teuthology.orchestra.run.smithi005.stdout:258.out 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:259 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:259.out 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:260 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:260.out 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:261 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:261.out 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:262 2023-08-09T14:17:48.377 INFO:teuthology.orchestra.run.smithi005.stdout:262.out 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:263 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:263.out 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:264 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:264.out 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:265 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:265.out 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:266 2023-08-09T14:17:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:266.out 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:267 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:267.out 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:268 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:268.out 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:269 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:269.out 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:270 2023-08-09T14:17:48.379 INFO:teuthology.orchestra.run.smithi005.stdout:270.out 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:271 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:271.out 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:272 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:272.out 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:273 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:273.out 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:274 2023-08-09T14:17:48.380 INFO:teuthology.orchestra.run.smithi005.stdout:274.out 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:275 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:275.out 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:276 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:276.out 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:277 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:277.out 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:278 2023-08-09T14:17:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:278.out 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:279 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:279.out 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:280 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:280.out 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:281 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:281.out 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:282 2023-08-09T14:17:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:282.out 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:283 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:283.out 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:284 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:284.out 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:285 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:285.out 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:286 2023-08-09T14:17:48.383 INFO:teuthology.orchestra.run.smithi005.stdout:286.out 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:287 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:287.out 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:288 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:288.out 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:289 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:289.out 2023-08-09T14:17:48.384 INFO:teuthology.orchestra.run.smithi005.stdout:290 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:290.out 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:291 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:291.out 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:292 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:292.out 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:293 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:293.out 2023-08-09T14:17:48.385 INFO:teuthology.orchestra.run.smithi005.stdout:294 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:294.out 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:295 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:295.out 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:296 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:296.out 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:297 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:297.out 2023-08-09T14:17:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:298 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:298.out 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:299 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:299.out 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:300 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:300.out 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:301 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:301.out 2023-08-09T14:17:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:302 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:302.out 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:303 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:303.out 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:304 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:304.out 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:305 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:305.out 2023-08-09T14:17:48.388 INFO:teuthology.orchestra.run.smithi005.stdout:306 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:306.out 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:307 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:307.out 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:308 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:308.out 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:309 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:309.out 2023-08-09T14:17:48.389 INFO:teuthology.orchestra.run.smithi005.stdout:310 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:310.out 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:311 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:311.out 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:312 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:312.out 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:313 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:313.out 2023-08-09T14:17:48.390 INFO:teuthology.orchestra.run.smithi005.stdout:314 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:314.out 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:315 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:315.out 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:316 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:316.out 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:317 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:317.out 2023-08-09T14:17:48.391 INFO:teuthology.orchestra.run.smithi005.stdout:318 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:318.out 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:319 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:319.out 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:320 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:320.out 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:321 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:321.out 2023-08-09T14:17:48.392 INFO:teuthology.orchestra.run.smithi005.stdout:322 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:322.out 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:323 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:323.out 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:324 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:324.out 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:325 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:325.out 2023-08-09T14:17:48.393 INFO:teuthology.orchestra.run.smithi005.stdout:326 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:326.out 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:327 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:327.out 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:328 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:328.out 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:329 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:329.out 2023-08-09T14:17:48.394 INFO:teuthology.orchestra.run.smithi005.stdout:330 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:330.out 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:331 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:331.out 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:332 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:332.out 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:333 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:333.out 2023-08-09T14:17:48.395 INFO:teuthology.orchestra.run.smithi005.stdout:334 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:334.out 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:335 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:335.out 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:336 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:336.out 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:337 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:337.out 2023-08-09T14:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:338 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:338.out 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:339 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:339.out 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:340 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:340.out 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:341 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:341.out 2023-08-09T14:17:48.397 INFO:teuthology.orchestra.run.smithi005.stdout:342 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:342.out 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:343 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:343.out 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:344 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:344.out 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:345 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:345.out 2023-08-09T14:17:48.398 INFO:teuthology.orchestra.run.smithi005.stdout:346 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:346.out 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:347 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:347.out 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:348 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:348.out 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:349 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:349.out 2023-08-09T14:17:48.399 INFO:teuthology.orchestra.run.smithi005.stdout:350 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:350.out 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:351 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:351.out 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:352 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:352.out 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:353 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:353.out 2023-08-09T14:17:48.400 INFO:teuthology.orchestra.run.smithi005.stdout:354 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:354.out 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:355 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:355.out 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:356 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:356.out 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:357 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:357.out 2023-08-09T14:17:48.401 INFO:teuthology.orchestra.run.smithi005.stdout:358 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:358.out 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:359 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:359.out 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:360 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:360.out 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:361 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:361.out 2023-08-09T14:17:48.402 INFO:teuthology.orchestra.run.smithi005.stdout:362 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:362.out 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:363 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:363.out 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:364 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:364.out 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:365 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:365.out 2023-08-09T14:17:48.403 INFO:teuthology.orchestra.run.smithi005.stdout:366 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:366.out 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:367 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:367.out 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:368 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:368.out 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:369 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:369.out 2023-08-09T14:17:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:370 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:370.out 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:371 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:371.out 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:372 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:372.out 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:373 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:373.out 2023-08-09T14:17:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:374 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:374.out 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:375 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:375.out 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:376 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:376.out 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:377 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:377.out 2023-08-09T14:17:48.406 INFO:teuthology.orchestra.run.smithi005.stdout:378 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:378.out 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:379 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:379.out 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:380 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:380.out 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:381 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:381.out 2023-08-09T14:17:48.407 INFO:teuthology.orchestra.run.smithi005.stdout:382 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:382.out 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:383 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:383.out 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:384 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:384.out 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:385 2023-08-09T14:17:48.408 INFO:teuthology.orchestra.run.smithi005.stdout:385.out 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:386 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:386.out 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:387 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:387.out 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:388 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:388.out 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:389 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:389.out 2023-08-09T14:17:48.409 INFO:teuthology.orchestra.run.smithi005.stdout:390 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:390.out 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:391 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:391.out 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:392 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:392.out 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:393 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:393.out 2023-08-09T14:17:48.410 INFO:teuthology.orchestra.run.smithi005.stdout:394 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:394.out 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:395 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:395.out 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:396 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:396.out 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:397 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:397.out 2023-08-09T14:17:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:398 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:398.out 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:399 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:399.out 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:400 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:400.out 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:401 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:401.out 2023-08-09T14:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:402 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:402.out 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:403 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:403.out 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:404 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:404.out 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:405 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:405.out 2023-08-09T14:17:48.413 INFO:teuthology.orchestra.run.smithi005.stdout:406 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:406.out 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:407 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:407.out 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:408 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:408.out 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:409 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:409.out 2023-08-09T14:17:48.414 INFO:teuthology.orchestra.run.smithi005.stdout:410 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:410.out 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:411 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:411.out 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:412 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:412.out 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:413 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:413.out 2023-08-09T14:17:48.415 INFO:teuthology.orchestra.run.smithi005.stdout:414 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:414.out 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:415 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:415.out 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:416 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:416.out 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:417 2023-08-09T14:17:48.416 INFO:teuthology.orchestra.run.smithi005.stdout:417.out 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:418 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:418.out 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:419 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:419.out 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:420 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:420.out 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:421 2023-08-09T14:17:48.417 INFO:teuthology.orchestra.run.smithi005.stdout:421.out 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:422 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:422.out 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:423 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:423.out 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:424 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:424.out 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:425 2023-08-09T14:17:48.418 INFO:teuthology.orchestra.run.smithi005.stdout:425.out 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:426 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:426.out 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:427 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:427.out 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:428 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:428.out 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:429 2023-08-09T14:17:48.419 INFO:teuthology.orchestra.run.smithi005.stdout:429.out 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:430 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:430.out 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:431 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:431.out 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:432 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:432.out 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:433 2023-08-09T14:17:48.420 INFO:teuthology.orchestra.run.smithi005.stdout:433.out 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:434 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:434.out 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:435 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:435.out 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:436 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:436.out 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:437 2023-08-09T14:17:48.421 INFO:teuthology.orchestra.run.smithi005.stdout:437.out 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:438 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:438.out 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:439 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:439.out 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:440 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:440.out 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:441 2023-08-09T14:17:48.422 INFO:teuthology.orchestra.run.smithi005.stdout:441.out 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:442 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:442.out 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:443 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:443.out 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:444 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:444.out 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:445 2023-08-09T14:17:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:445.out 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:446 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:446.out 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:447 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:447.out 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:448 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:448.out 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:449 2023-08-09T14:17:48.424 INFO:teuthology.orchestra.run.smithi005.stdout:449.out 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:450 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:450.out 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:451 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:451.out 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:452 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:452.out 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:453 2023-08-09T14:17:48.425 INFO:teuthology.orchestra.run.smithi005.stdout:453.out 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:454 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:454.out 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:455 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:455.out 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:456 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:456.out 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:457 2023-08-09T14:17:48.426 INFO:teuthology.orchestra.run.smithi005.stdout:457.out 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:458 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:458.out 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:459 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:459.out 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:460 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:460.out 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:461 2023-08-09T14:17:48.427 INFO:teuthology.orchestra.run.smithi005.stdout:461.out 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:462 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:462.out 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:463 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:463.out 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:464 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:464.out 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:465 2023-08-09T14:17:48.428 INFO:teuthology.orchestra.run.smithi005.stdout:465.out 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:466 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:466.out 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:467 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:467.out 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:468 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:468.out 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:469 2023-08-09T14:17:48.429 INFO:teuthology.orchestra.run.smithi005.stdout:469.out 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:470 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:470.out 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:471 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:471.out 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:472 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:472.out 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:473 2023-08-09T14:17:48.430 INFO:teuthology.orchestra.run.smithi005.stdout:473.out 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:474 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:474.out 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:475 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:475.out 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:476 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:476.out 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:477 2023-08-09T14:17:48.431 INFO:teuthology.orchestra.run.smithi005.stdout:477.out 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:478 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:478.out 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:479 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:479.out 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:480 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:480.out 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:481 2023-08-09T14:17:48.432 INFO:teuthology.orchestra.run.smithi005.stdout:481.out 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:482 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:482.out 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:483 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:483.out 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:484 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:484.out 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:485 2023-08-09T14:17:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:485.out 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:486 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:486.out 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:487 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:487.out 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:488 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:488.out 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:489 2023-08-09T14:17:48.434 INFO:teuthology.orchestra.run.smithi005.stdout:489.out 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:490 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:490.out 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:491 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:491.out 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:492 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:492.out 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:493 2023-08-09T14:17:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:493.out 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:494 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:494.out 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:495 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:495.out 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:496 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:496.out 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:497 2023-08-09T14:17:48.436 INFO:teuthology.orchestra.run.smithi005.stdout:497.out 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:498 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:498.out 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:499 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:499.out 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:500 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:500.out 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:501 2023-08-09T14:17:48.437 INFO:teuthology.orchestra.run.smithi005.stdout:501.out 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:502 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:502.out 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:503 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:503.out 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:504 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:504.out 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:505 2023-08-09T14:17:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:505.out 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:506 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:506.out 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:507 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:507.out 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:508 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:508.out 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:509 2023-08-09T14:17:48.439 INFO:teuthology.orchestra.run.smithi005.stdout:509.out 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:510 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:510.out 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:511 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:511.out 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:512 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:512.out 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:513 2023-08-09T14:17:48.440 INFO:teuthology.orchestra.run.smithi005.stdout:513.out 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:514 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:514.out 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:515 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:515.out 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:516 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:516.out 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:517 2023-08-09T14:17:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:517.out 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:518 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:518.out 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:519 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:519.out 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:520 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:520.out 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:521 2023-08-09T14:17:48.442 INFO:teuthology.orchestra.run.smithi005.stdout:521.out 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:522 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:522.out 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:523 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:523.out 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:524 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:524.out 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:525 2023-08-09T14:17:48.443 INFO:teuthology.orchestra.run.smithi005.stdout:525.out 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:526 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:526.out 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:527 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:527.out 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:528 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:528.out 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:529 2023-08-09T14:17:48.444 INFO:teuthology.orchestra.run.smithi005.stdout:529.out 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:530 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:530.out 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:531 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:531.out 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:532 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:532.out 2023-08-09T14:17:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:533 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:533.out 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:534 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:534.out 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:535 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:535.out 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:536 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:536.out 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:537 2023-08-09T14:17:48.446 INFO:teuthology.orchestra.run.smithi005.stdout:537.out 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:538 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:538.out 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:539 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:539.out 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:540 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:540.out 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:541 2023-08-09T14:17:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:541.out 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:542 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:542.out 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:543 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:543.out 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:544 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:544.out 2023-08-09T14:17:48.448 INFO:teuthology.orchestra.run.smithi005.stdout:545 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:545.out 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:546 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:546.out 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:547 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:547.out 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:548 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:548.out 2023-08-09T14:17:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:549 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:549.out 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:550 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:550.out 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:551 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:551.out 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:552 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:552.out 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:553 2023-08-09T14:17:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:553.out 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:554 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:554.out 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:555 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:555.out 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:556 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:556.out 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:557 2023-08-09T14:17:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:557.out 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:558 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:558.out 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:559 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:559.out 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:560 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:560.out 2023-08-09T14:17:48.452 INFO:teuthology.orchestra.run.smithi005.stdout:561 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:561.out 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:562 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:562.out 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:563 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:563.out 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:564 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:564.out 2023-08-09T14:17:48.453 INFO:teuthology.orchestra.run.smithi005.stdout:565 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:565.out 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:566 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:566.out 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:567 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:567.out 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:568 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:568.out 2023-08-09T14:17:48.454 INFO:teuthology.orchestra.run.smithi005.stdout:569 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:569.out 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:570 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:570.out 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:571 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:571.out 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:572 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:572.out 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:573 2023-08-09T14:17:48.455 INFO:teuthology.orchestra.run.smithi005.stdout:573.out 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:574 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:574.out 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:575 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:575.out 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:576 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:576.out 2023-08-09T14:17:48.456 INFO:teuthology.orchestra.run.smithi005.stdout:577 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:577.out 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:578 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:578.out 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:579 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:579.out 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:580 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:580.out 2023-08-09T14:17:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:581 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:581.out 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:582 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:582.out 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:583 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:583.out 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:584 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:584.out 2023-08-09T14:17:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:585 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:585.out 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:586 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:586.out 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:587 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:587.out 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:588 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:588.out 2023-08-09T14:17:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:589 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:589.out 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:590 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:590.out 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:591 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:591.out 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:592 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:592.out 2023-08-09T14:17:48.460 INFO:teuthology.orchestra.run.smithi005.stdout:593 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:593.out 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:594 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:594.out 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:595 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:595.out 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:596 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:596.out 2023-08-09T14:17:48.461 INFO:teuthology.orchestra.run.smithi005.stdout:597 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:597.out 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:598 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:598.out 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:599 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:599.out 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:600 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:600.out 2023-08-09T14:17:48.462 INFO:teuthology.orchestra.run.smithi005.stdout:601 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:601.out 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:602 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:602.out 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:603 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:603.out 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:604 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:604.out 2023-08-09T14:17:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:605 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:605.out 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:606 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:606.out 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:607 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:607.out 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:608 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:608.out 2023-08-09T14:17:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:609 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:609.out 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:610 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:610.out 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:611 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:611.out 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:612 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:612.out 2023-08-09T14:17:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:613 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:613.out 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:614 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:614.out 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:615 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:615.out 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:616 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:616.out 2023-08-09T14:17:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:617 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:617.out 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:618 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:618.out 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:619 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:619.out 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:620 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:620.out 2023-08-09T14:17:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:621 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:621.out 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:622 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:622.out 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:623 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:623.out 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:624 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:624.out 2023-08-09T14:17:48.468 INFO:teuthology.orchestra.run.smithi005.stdout:625 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:625.out 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:626 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:626.out 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:627 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:627.out 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:628 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:628.out 2023-08-09T14:17:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:629 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:629.out 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:630 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:630.out 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:631 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:631.out 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:632 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:632.out 2023-08-09T14:17:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:633 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:633.out 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:634 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:634.out 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:635 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:635.out 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:636 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:636.out 2023-08-09T14:17:48.471 INFO:teuthology.orchestra.run.smithi005.stdout:637 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:637.out 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:638 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:638.out 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:639 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:639.out 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:640 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:640.out 2023-08-09T14:17:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:641 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:641.out 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:642 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:642.out 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:643 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:643.out 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:644 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:644.out 2023-08-09T14:17:48.473 INFO:teuthology.orchestra.run.smithi005.stdout:645 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:645.out 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:646 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:646.out 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:647 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:647.out 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:648 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:648.out 2023-08-09T14:17:48.474 INFO:teuthology.orchestra.run.smithi005.stdout:649 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:649.out 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:650 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:650.out 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:651 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:651.out 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:652 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:652.out 2023-08-09T14:17:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:653 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:653.out 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:654 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:654.out 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:655 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:655.out 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:656 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:656.out 2023-08-09T14:17:48.476 INFO:teuthology.orchestra.run.smithi005.stdout:657 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:657.out 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:658 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:658.out 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:659 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:659.out 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:660 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:660.out 2023-08-09T14:17:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:661 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:661.out 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:662 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:662.out 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:663 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:663.out 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:664 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:664.out 2023-08-09T14:17:48.478 INFO:teuthology.orchestra.run.smithi005.stdout:665 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:665.out 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:666 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:666.out 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:667 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:667.out 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:668 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:668.out 2023-08-09T14:17:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:669 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:669.out 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:670 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:670.out 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:671 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:671.out 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:672 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:672.out 2023-08-09T14:17:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:673 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:673.out 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:674 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:674.out 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:675 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:675.out 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:676 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:676.out 2023-08-09T14:17:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:677 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:677.out 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:678 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:678.out 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:679 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:679.out 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:680 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:680.out 2023-08-09T14:17:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:681 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:681.out 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:682 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:682.out 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:683 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:683.out 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:684 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:684.out 2023-08-09T14:17:48.483 INFO:teuthology.orchestra.run.smithi005.stdout:685 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:685.out 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:686 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:686.out 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:687 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:687.out 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:688 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:688.out 2023-08-09T14:17:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:689 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:689.out 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:690 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:690.out 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:691 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:691.out 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:692 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:692.out 2023-08-09T14:17:48.485 INFO:teuthology.orchestra.run.smithi005.stdout:693 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:693.out 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:694 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:694.out 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:695 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:695.out 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:696 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:696.out 2023-08-09T14:17:48.486 INFO:teuthology.orchestra.run.smithi005.stdout:697 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:697.out 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:698 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:698.out 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:699 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:699.out 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:700 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:700.out 2023-08-09T14:17:48.487 INFO:teuthology.orchestra.run.smithi005.stdout:701 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:701.out 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:702 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:702.out 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:703 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:703.out 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:704 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:704.out 2023-08-09T14:17:48.488 INFO:teuthology.orchestra.run.smithi005.stdout:705 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:705.out 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:706 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:706.out 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:707 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:707.out 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:708 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:708.out 2023-08-09T14:17:48.489 INFO:teuthology.orchestra.run.smithi005.stdout:709 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:709.out 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:710 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:710.out 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:711 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:711.out 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:712 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:712.out 2023-08-09T14:17:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:713 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:713.out 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:714 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:714.out 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:715 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:715.out 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:716 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:716.out 2023-08-09T14:17:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:717 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:717.out 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:718 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:718.out 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:719 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:719.out 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:720 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:720.out 2023-08-09T14:17:48.492 INFO:teuthology.orchestra.run.smithi005.stdout:721 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:721.out 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:722 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:722.out 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:723 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:723.out 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:724 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:724.out 2023-08-09T14:17:48.493 INFO:teuthology.orchestra.run.smithi005.stdout:725 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:725.out 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:726 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:726.out 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:727 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:727.out 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:728 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:728.out 2023-08-09T14:17:48.494 INFO:teuthology.orchestra.run.smithi005.stdout:729 2023-08-09T14:17:48.495 INFO:teuthology.orchestra.run.smithi005.stdout:729.out 2023-08-09T14:17:48.495 INFO:teuthology.orchestra.run.smithi005.stdout:group.list 2023-08-09T14:17:48.495 INFO:teuthology.orchestra.run.smithi005.stdout:Makefile 2023-08-09T14:17:48.495 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-08-09T14:17:48.728 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:48.732 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:48.732 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:48.733 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:48.733 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:53.557 INFO:teuthology.orchestra.run.smithi005.stdout:generic/001 5s 2023-08-09T14:17:53.561 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/001 2023-08-09T14:17:53.562 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:17:53.563 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:54.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:17:54.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-08-09T14:17:54.537 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:54.541 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:generic/002 1s 2023-08-09T14:17:55.175 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/002 2023-08-09T14:17:55.176 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:17:55.177 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:55.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:17:55.232 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-08-09T14:17:55.462 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:55.466 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:55.466 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:55.467 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:55.803 INFO:teuthology.orchestra.run.smithi005.stdout:generic/003 [not run] atime not maintained by ceph 2023-08-09T14:17:55.807 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/003 2023-08-09T14:17:55.807 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/003 2023-08-09T14:17:55.808 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:17:55.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:55.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:17:55.832 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-08-09T14:17:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:56.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:56.402 INFO:teuthology.orchestra.run.smithi005.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-09T14:17:56.406 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/004 2023-08-09T14:17:56.407 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/004 2023-08-09T14:17:56.407 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:17:56.408 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:56.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:17:56.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-08-09T14:17:56.655 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:56.659 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:56.659 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:56.660 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:57.169 INFO:teuthology.orchestra.run.smithi005.stdout:generic/005 1s 2023-08-09T14:17:57.174 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/005 2023-08-09T14:17:57.174 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:17:57.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:17:57.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:17:57.271 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-08-09T14:17:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:17:57.519 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:17:57.519 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:17:57.520 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:17:57.520 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:18:03.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:18:03.853 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:18:21.706 INFO:teuthology.orchestra.run.smithi005.stdout:generic/006 24s 2023-08-09T14:18:21.710 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/006 2023-08-09T14:18:21.711 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:18:21.712 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:18:21.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:18:21.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-08-09T14:18:22.229 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:18:22.233 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:18:22.233 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:18:22.234 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:18:22.235 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:18:33.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:18:33.946 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:19:04.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:19:04.016 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:19:11.704 INFO:teuthology.orchestra.run.smithi005.stdout:generic/007 49s 2023-08-09T14:19:11.849 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/007 2023-08-09T14:19:11.850 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:11.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:11.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-08-09T14:19:12.158 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:12.162 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:12.163 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:12.164 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:12.164 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:12.608 INFO:teuthology.orchestra.run.smithi005.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-09T14:19:12.612 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/008 2023-08-09T14:19:12.612 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/008 2023-08-09T14:19:12.612 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:12.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:12.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:12.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-08-09T14:19:12.909 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:12.916 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:12.917 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:12.917 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:13.299 INFO:teuthology.orchestra.run.smithi005.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-09T14:19:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/009 2023-08-09T14:19:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/009 2023-08-09T14:19:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:13.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:13.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:13.343 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-08-09T14:19:13.575 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:13.579 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:13.580 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:13.581 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:13.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:13.903 INFO:teuthology.orchestra.run.smithi005.stdout:generic/010 [not run] /tmp/tmp.cj6W3QcazExfstests-dev/src/dbtest not built 2023-08-09T14:19:13.907 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/010 2023-08-09T14:19:13.907 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/010 2023-08-09T14:19:13.907 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:13.909 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:13.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:13.929 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-08-09T14:19:14.147 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:14.151 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:14.151 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:14.152 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:34.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:19:34.083 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:19:44.688 INFO:teuthology.orchestra.run.smithi005.stdout:generic/011 30s 2023-08-09T14:19:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/011 2023-08-09T14:19:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:44.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:44.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:44.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-08-09T14:19:45.202 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:45.206 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:45.206 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:45.207 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:45.207 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:45.636 INFO:teuthology.orchestra.run.smithi005.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:19:45.640 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/012 2023-08-09T14:19:45.640 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/012 2023-08-09T14:19:45.640 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:19:45.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:19:45.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:19:45.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-08-09T14:19:46.050 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:19:46.055 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:19:46.055 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:19:46.056 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:19:46.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:20:04.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:20:04.184 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:20:34.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:20:34.329 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:20:56.581 INFO:teuthology.orchestra.run.smithi005.stdout:generic/013 70s 2023-08-09T14:20:56.639 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/013 2023-08-09T14:20:56.639 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:20:56.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:20:56.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:20:56.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-08-09T14:20:57.028 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:20:57.036 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:20:57.037 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:20:57.039 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:20:57.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:21:04.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:21:04.596 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:21:34.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:21:34.921 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:22:04.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:22:05.003 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:22:35.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:22:35.108 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:23:05.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:23:05.189 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:23:35.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:23:35.293 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:24:05.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:24:05.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:24:35.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:24:35.529 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:25:05.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:25:05.644 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:25:26.893 INFO:teuthology.orchestra.run.smithi005.stdout:generic/014 269s 2023-08-09T14:25:26.903 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/014 2023-08-09T14:25:26.903 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:26.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:26.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-08-09T14:25:27.346 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:27.360 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:27.362 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:27.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:27.808 INFO:teuthology.orchestra.run.smithi005.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-09T14:25:27.813 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/015 2023-08-09T14:25:27.813 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/015 2023-08-09T14:25:27.813 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:27.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:27.849 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-08-09T14:25:28.214 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:28.225 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:28.225 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:28.228 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:28.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:28.810 INFO:teuthology.orchestra.run.smithi005.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:25:28.815 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/016 2023-08-09T14:25:28.815 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/016 2023-08-09T14:25:28.816 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:28.818 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:29.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:29.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-08-09T14:25:29.492 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:29.496 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:29.497 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:29.498 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:30.044 INFO:teuthology.orchestra.run.smithi005.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-09T14:25:30.050 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/017 2023-08-09T14:25:30.051 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/017 2023-08-09T14:25:30.051 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:30.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:30.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-08-09T14:25:30.463 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:30.468 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:30.468 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:30.469 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:31.138 INFO:teuthology.orchestra.run.smithi005.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-08-09T14:25:31.158 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/018 2023-08-09T14:25:31.159 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/018 2023-08-09T14:25:31.159 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:31.162 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:31.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:31.193 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-08-09T14:25:31.580 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:31.585 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:31.586 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:31.587 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:31.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:32.048 INFO:teuthology.orchestra.run.smithi005.stdout:generic/019 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:25:32.053 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/019 2023-08-09T14:25:32.054 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/019 2023-08-09T14:25:32.054 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:32.055 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:32.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:32.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-08-09T14:25:32.408 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:32.417 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:32.417 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:32.418 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:35.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:25:35.867 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:25:35.956 INFO:teuthology.orchestra.run.smithi005.stdout:generic/020 3s 2023-08-09T14:25:35.981 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/020 2023-08-09T14:25:35.981 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:35.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:36.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:36.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-08-09T14:25:36.643 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:36.651 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:36.652 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:36.652 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:36.653 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:37.306 INFO:teuthology.orchestra.run.smithi005.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:25:37.313 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/021 2023-08-09T14:25:37.313 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/021 2023-08-09T14:25:37.314 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:37.316 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:37.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:37.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-08-09T14:25:38.035 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:38.039 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:38.040 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:38.041 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:38.041 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:38.644 INFO:teuthology.orchestra.run.smithi005.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:25:38.651 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/022 2023-08-09T14:25:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/022 2023-08-09T14:25:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:25:38.654 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:25:38.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:25:38.977 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-08-09T14:25:39.366 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:25:39.372 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:25:39.373 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:25:39.374 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:25:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:05.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:26:05.983 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:26:36.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:26:36.071 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:26:39.678 INFO:teuthology.orchestra.run.smithi005.stdout:generic/023 60s 2023-08-09T14:26:39.685 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/023 2023-08-09T14:26:39.686 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:40.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:40.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-08-09T14:26:40.420 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:40.425 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:40.426 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:40.427 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:40.940 INFO:teuthology.orchestra.run.smithi005.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-09T14:26:40.945 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/024 2023-08-09T14:26:40.945 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/024 2023-08-09T14:26:40.945 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:41.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:41.226 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-08-09T14:26:41.643 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:41.648 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:41.648 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:41.649 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:41.650 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:42.166 INFO:teuthology.orchestra.run.smithi005.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-09T14:26:42.172 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/025 2023-08-09T14:26:42.173 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/025 2023-08-09T14:26:42.173 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:42.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:42.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:42.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-08-09T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:42.880 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:42.881 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:42.882 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:43.428 INFO:teuthology.orchestra.run.smithi005.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-08-09T14:26:43.435 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/026 2023-08-09T14:26:43.436 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/026 2023-08-09T14:26:43.436 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:43.438 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:43.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:43.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-08-09T14:26:43.843 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:43.854 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:43.855 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:43.856 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:43.856 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:44.326 INFO:teuthology.orchestra.run.smithi005.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-09T14:26:44.343 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/027 2023-08-09T14:26:44.343 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/027 2023-08-09T14:26:44.344 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:44.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:44.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:44.379 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-08-09T14:26:44.738 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:44.747 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:44.748 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:44.748 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:50.253 INFO:teuthology.orchestra.run.smithi005.stdout:generic/028 5s 2023-08-09T14:26:50.258 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/028 2023-08-09T14:26:50.259 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:50.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:50.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:50.292 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-08-09T14:26:50.674 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:50.680 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:50.680 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:50.681 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:50.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:55.056 INFO:teuthology.orchestra.run.smithi005.stdout:generic/029 5s 2023-08-09T14:26:55.066 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/029 2023-08-09T14:26:55.067 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:26:55.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:26:55.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:26:55.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-08-09T14:26:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:26:55.442 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:26:55.443 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:26:55.444 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:26:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:00.184 INFO:teuthology.orchestra.run.smithi005.stdout:generic/030 5s 2023-08-09T14:27:00.190 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/030 2023-08-09T14:27:00.190 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:00.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:00.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:00.211 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-08-09T14:27:00.560 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:00.571 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:00.572 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:00.573 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:00.573 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:01.183 INFO:teuthology.orchestra.run.smithi005.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-09T14:27:01.195 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/031 2023-08-09T14:27:01.196 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/031 2023-08-09T14:27:01.196 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:01.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:01.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:01.251 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-08-09T14:27:01.583 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:01.587 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:01.587 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:01.588 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:01.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:01.928 INFO:teuthology.orchestra.run.smithi005.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:01.932 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/032 2023-08-09T14:27:01.932 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/032 2023-08-09T14:27:01.932 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:01.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:01.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:01.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-08-09T14:27:02.180 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:02.185 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:02.185 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:02.186 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:02.579 INFO:teuthology.orchestra.run.smithi005.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-09T14:27:02.583 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/033 2023-08-09T14:27:02.583 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/033 2023-08-09T14:27:02.583 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:02.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:02.611 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-08-09T14:27:02.831 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:02.835 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:02.836 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:02.837 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:02.837 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:03.191 INFO:teuthology.orchestra.run.smithi005.stdout:generic/034 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:03.195 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/034 2023-08-09T14:27:03.196 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/034 2023-08-09T14:27:03.196 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:03.197 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:03.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:03.226 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-08-09T14:27:03.444 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:03.448 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:03.449 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:03.450 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:03.450 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:03.833 INFO:teuthology.orchestra.run.smithi005.stdout:generic/035 0s 2023-08-09T14:27:03.838 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/035 2023-08-09T14:27:03.838 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:03.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:04.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:04.016 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-08-09T14:27:04.378 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:04.382 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:04.382 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:04.383 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:06.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:27:06.142 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:27:14.799 INFO:teuthology.orchestra.run.smithi005.stdout:generic/036 10s 2023-08-09T14:27:14.804 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/036 2023-08-09T14:27:14.804 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:14.806 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:15.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:15.097 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-08-09T14:27:15.361 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:15.365 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:15.367 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:15.367 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:18.058 INFO:teuthology.orchestra.run.smithi005.stdout:generic/037 3s 2023-08-09T14:27:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/037 2023-08-09T14:27:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:18.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:18.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-08-09T14:27:18.297 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:18.301 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:18.302 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:18.302 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:18.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:18.640 INFO:teuthology.orchestra.run.smithi005.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:18.644 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/038 2023-08-09T14:27:18.644 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/038 2023-08-09T14:27:18.644 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:18.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:18.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:18.671 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-08-09T14:27:18.886 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:18.890 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:18.890 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:18.891 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:18.891 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:19.246 INFO:teuthology.orchestra.run.smithi005.stdout:generic/039 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:19.250 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/039 2023-08-09T14:27:19.250 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/039 2023-08-09T14:27:19.250 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:19.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:19.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:19.279 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-08-09T14:27:19.496 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:19.501 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:19.501 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:19.502 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:19.502 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:19.852 INFO:teuthology.orchestra.run.smithi005.stdout:generic/040 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:19.856 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/040 2023-08-09T14:27:19.856 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/040 2023-08-09T14:27:19.856 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:19.858 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:19.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:19.887 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-08-09T14:27:20.112 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:20.116 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:20.117 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:20.117 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:20.460 INFO:teuthology.orchestra.run.smithi005.stdout:generic/041 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:20.464 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/041 2023-08-09T14:27:20.464 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/041 2023-08-09T14:27:20.465 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:20.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:20.492 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-08-09T14:27:20.711 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:20.716 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:20.716 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:20.717 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:21.217 INFO:teuthology.orchestra.run.smithi005.stdout:generic/042 [not run] ceph does not support shutdown 2023-08-09T14:27:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/042 2023-08-09T14:27:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/042 2023-08-09T14:27:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:21.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:21.266 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-08-09T14:27:21.490 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:21.494 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:21.494 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:21.495 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:21.986 INFO:teuthology.orchestra.run.smithi005.stdout:generic/043 [not run] ceph does not support shutdown 2023-08-09T14:27:22.008 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/043 2023-08-09T14:27:22.008 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/043 2023-08-09T14:27:22.008 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:22.009 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:22.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:22.039 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-08-09T14:27:22.266 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:22.271 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:22.271 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:22.272 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:22.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:22.762 INFO:teuthology.orchestra.run.smithi005.stdout:generic/044 [not run] ceph does not support shutdown 2023-08-09T14:27:22.784 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/044 2023-08-09T14:27:22.784 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/044 2023-08-09T14:27:22.784 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:22.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:22.805 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-08-09T14:27:23.026 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:23.030 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:23.030 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:23.031 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:23.031 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:23.528 INFO:teuthology.orchestra.run.smithi005.stdout:generic/045 [not run] ceph does not support shutdown 2023-08-09T14:27:23.542 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/045 2023-08-09T14:27:23.543 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/045 2023-08-09T14:27:23.543 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:23.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:23.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:23.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-08-09T14:27:23.796 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:23.800 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:23.800 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:23.801 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:23.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:24.302 INFO:teuthology.orchestra.run.smithi005.stdout:generic/046 [not run] ceph does not support shutdown 2023-08-09T14:27:24.317 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/046 2023-08-09T14:27:24.318 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/046 2023-08-09T14:27:24.318 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:24.319 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:24.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:24.344 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-08-09T14:27:24.566 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:24.570 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:24.571 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:24.571 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:25.059 INFO:teuthology.orchestra.run.smithi005.stdout:generic/047 [not run] ceph does not support shutdown 2023-08-09T14:27:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/047 2023-08-09T14:27:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/047 2023-08-09T14:27:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:25.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:25.099 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-08-09T14:27:25.315 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:25.319 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:25.320 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:25.321 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:25.809 INFO:teuthology.orchestra.run.smithi005.stdout:generic/048 [not run] ceph does not support shutdown 2023-08-09T14:27:25.829 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/048 2023-08-09T14:27:25.830 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/048 2023-08-09T14:27:25.830 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:25.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:25.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-08-09T14:27:26.078 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:26.082 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:26.083 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:26.084 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:26.596 INFO:teuthology.orchestra.run.smithi005.stdout:generic/049 [not run] ceph does not support shutdown 2023-08-09T14:27:26.612 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/049 2023-08-09T14:27:26.613 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/049 2023-08-09T14:27:26.613 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:26.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:26.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-08-09T14:27:26.857 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:26.862 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:26.862 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:26.863 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:27.381 INFO:teuthology.orchestra.run.smithi005.stdout:generic/050 [not run] ceph does not support shutdown 2023-08-09T14:27:27.394 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/050 2023-08-09T14:27:27.394 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/050 2023-08-09T14:27:27.395 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:27.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:27.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-08-09T14:27:27.642 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:27.646 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:27.646 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:27.647 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:28.170 INFO:teuthology.orchestra.run.smithi005.stdout:generic/051 [not run] ceph does not support shutdown 2023-08-09T14:27:28.174 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/051 2023-08-09T14:27:28.175 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/051 2023-08-09T14:27:28.175 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:28.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:28.201 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-08-09T14:27:28.420 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:28.424 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:28.425 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:28.426 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:28.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:28.901 INFO:teuthology.orchestra.run.smithi005.stdout:generic/052 [not run] ceph does not support shutdown 2023-08-09T14:27:28.919 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/052 2023-08-09T14:27:28.919 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/052 2023-08-09T14:27:28.920 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:28.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:28.946 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-08-09T14:27:29.165 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:29.169 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:29.169 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:29.170 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:30.084 INFO:teuthology.orchestra.run.smithi005.stdout:generic/053 1s 2023-08-09T14:27:30.104 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/053 2023-08-09T14:27:30.104 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:30.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:30.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:30.117 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-08-09T14:27:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:30.858 INFO:teuthology.orchestra.run.smithi005.stdout:generic/054 [not run] ceph does not support shutdown 2023-08-09T14:27:30.874 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/054 2023-08-09T14:27:30.874 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/054 2023-08-09T14:27:30.875 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:30.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:30.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-08-09T14:27:31.132 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:31.137 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:31.137 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:31.138 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:31.631 INFO:teuthology.orchestra.run.smithi005.stdout:generic/055 [not run] ceph does not support shutdown 2023-08-09T14:27:31.654 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/055 2023-08-09T14:27:31.654 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/055 2023-08-09T14:27:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:31.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:31.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:31.680 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-08-09T14:27:31.894 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:31.898 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:31.898 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:31.899 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:31.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:32.254 INFO:teuthology.orchestra.run.smithi005.stdout:generic/056 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:32.257 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/056 2023-08-09T14:27:32.258 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/056 2023-08-09T14:27:32.258 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:32.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:32.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:32.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-08-09T14:27:32.499 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:32.503 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:32.504 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:32.504 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:32.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:32.852 INFO:teuthology.orchestra.run.smithi005.stdout:generic/057 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:32.856 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/057 2023-08-09T14:27:32.857 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/057 2023-08-09T14:27:32.857 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:32.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:32.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-08-09T14:27:33.102 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:33.106 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:33.107 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:33.108 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:33.523 INFO:teuthology.orchestra.run.smithi005.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:33.527 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/058 2023-08-09T14:27:33.527 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/058 2023-08-09T14:27:33.527 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:33.529 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:33.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:33.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-08-09T14:27:34.092 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:34.096 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:34.097 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:34.098 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:34.098 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:34.435 INFO:teuthology.orchestra.run.smithi005.stdout:generic/059 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:34.439 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/059 2023-08-09T14:27:34.440 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/059 2023-08-09T14:27:34.440 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:34.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:34.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:34.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-08-09T14:27:34.688 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:34.692 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:34.692 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:34.693 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:34.693 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:35.114 INFO:teuthology.orchestra.run.smithi005.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/060 2023-08-09T14:27:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/060 2023-08-09T14:27:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:35.120 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:35.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:35.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-08-09T14:27:35.675 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:35.680 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:35.681 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:35.681 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:35.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:36.105 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/061 2023-08-09T14:27:36.106 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/061 2023-08-09T14:27:36.106 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:36.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:36.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:36.243 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-08-09T14:27:36.637 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:36.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:27:36.640 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:27:36.641 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:36.642 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:36.644 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:36.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:38.499 INFO:teuthology.orchestra.run.smithi005.stdout:generic/062 2s 2023-08-09T14:27:38.505 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/062 2023-08-09T14:27:38.506 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:38.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:38.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-08-09T14:27:38.733 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:38.737 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:38.737 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:38.738 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:38.739 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:39.211 INFO:teuthology.orchestra.run.smithi005.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:27:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/063 2023-08-09T14:27:39.216 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/063 2023-08-09T14:27:39.216 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:39.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:39.483 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-08-09T14:27:39.753 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:39.757 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:39.758 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:39.759 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:40.121 INFO:teuthology.orchestra.run.smithi005.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-09T14:27:40.125 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/064 2023-08-09T14:27:40.125 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/064 2023-08-09T14:27:40.125 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:40.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:40.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-08-09T14:27:40.374 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:40.378 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:40.379 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:40.380 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:40.733 INFO:teuthology.orchestra.run.smithi005.stdout:generic/065 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:40.737 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/065 2023-08-09T14:27:40.737 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/065 2023-08-09T14:27:40.737 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:40.739 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:40.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:40.774 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-08-09T14:27:40.993 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:40.997 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:40.998 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:40.998 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:41.336 INFO:teuthology.orchestra.run.smithi005.stdout:generic/066 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:41.340 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/066 2023-08-09T14:27:41.340 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/066 2023-08-09T14:27:41.340 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:41.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:41.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:41.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-08-09T14:27:41.590 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:41.594 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:41.595 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:41.596 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:41.978 INFO:teuthology.orchestra.run.smithi005.stdout:generic/067 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:27:41.982 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/067 2023-08-09T14:27:41.983 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/067 2023-08-09T14:27:41.983 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:41.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:42.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:42.013 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-08-09T14:27:42.232 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:42.236 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:42.237 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:42.238 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:42.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:42.590 INFO:teuthology.orchestra.run.smithi005.stdout:generic/068 [not run] ceph does not support freezing 2023-08-09T14:27:42.594 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/068 2023-08-09T14:27:42.594 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/068 2023-08-09T14:27:42.594 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:42.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:42.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:42.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-08-09T14:27:42.839 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:42.843 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:42.843 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:42.844 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:42.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:49.676 INFO:teuthology.orchestra.run.smithi005.stdout:generic/069 6s 2023-08-09T14:27:49.738 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/069 2023-08-09T14:27:49.738 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:27:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:27:49.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:27:49.758 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-08-09T14:27:49.977 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:27:49.981 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:27:49.981 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:27:49.982 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:27:49.982 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:06.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:28:06.739 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:28:11.309 INFO:teuthology.orchestra.run.smithi005.stdout:generic/070 21s 2023-08-09T14:28:11.315 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/070 2023-08-09T14:28:11.315 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:28:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:11.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:28:11.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-08-09T14:28:12.025 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:28:12.030 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:28:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:28:12.032 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:28:12.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:12.511 INFO:teuthology.orchestra.run.smithi005.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-09T14:28:12.519 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/071 2023-08-09T14:28:12.520 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/071 2023-08-09T14:28:12.520 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:28:12.522 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:12.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:28:12.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-08-09T14:28:12.908 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:28:12.914 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:28:12.915 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:28:12.917 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:28:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:13.501 INFO:teuthology.orchestra.run.smithi005.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-09T14:28:13.507 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/072 2023-08-09T14:28:13.507 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/072 2023-08-09T14:28:13.507 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:28:13.509 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:13.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:28:13.547 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-08-09T14:28:13.861 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:28:13.865 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:28:13.866 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:28:13.867 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:28:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:14.333 INFO:teuthology.orchestra.run.smithi005.stdout:generic/073 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:28:14.338 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/073 2023-08-09T14:28:14.338 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/073 2023-08-09T14:28:14.339 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:28:14.341 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:14.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:28:14.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-08-09T14:28:14.731 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:28:14.737 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:28:14.737 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:28:14.741 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:28:14.741 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:34.721 INFO:teuthology.orchestra.run.smithi005.stdout:generic/074 20s 2023-08-09T14:28:34.727 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/074 2023-08-09T14:28:34.727 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:28:34.729 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:35.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:28:35.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-08-09T14:28:35.714 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:28:35.719 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:28:35.719 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:28:35.720 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:28:35.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:28:36.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:28:36.839 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:28:36.937 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-08-09T14:28:36.935+0000 7f801bf3a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205254) UID: 0 2023-08-09T14:28:36.939 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-08-09T14:28:36.938+0000 7f9a20c9e700 -1 Fail to open '/proc/205254/cmdline' error = (2) No such file or directory 2023-08-09T14:28:36.940 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-08-09T14:28:36.938+0000 7f9a20c9e700 -1 received signal: Hangup from (PID: 205254) UID: 0 2023-08-09T14:29:12.323 INFO:teuthology.orchestra.run.smithi005.stdout:generic/075 37s 2023-08-09T14:29:12.336 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/075 2023-08-09T14:29:12.336 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:12.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:12.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:12.598 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-08-09T14:29:13.217 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:13.222 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:13.224 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:13.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:13.739 INFO:teuthology.orchestra.run.smithi005.stdout:generic/076 [not run] require 172.21.15.5:6789:/scratch to be local device 2023-08-09T14:29:13.745 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/076 2023-08-09T14:29:13.746 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/076 2023-08-09T14:29:13.746 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:13.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:13.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:13.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-08-09T14:29:14.183 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:14.190 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:14.190 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:14.192 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:14.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:17.382 INFO:teuthology.orchestra.run.smithi005.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-09T14:29:17.390 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/077 2023-08-09T14:29:17.390 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/077 2023-08-09T14:29:17.390 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:17.393 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:17.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:17.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-08-09T14:29:18.231 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:18.254 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:18.255 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:18.256 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:18.256 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-09T14:29:18.858 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/078 2023-08-09T14:29:18.859 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/078 2023-08-09T14:29:18.859 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:18.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:19.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:19.289 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-08-09T14:29:19.737 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:19.747 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:19.749 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:19.755 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:20.368 INFO:teuthology.orchestra.run.smithi005.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-09T14:29:20.374 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/079 2023-08-09T14:29:20.375 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/079 2023-08-09T14:29:20.375 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:20.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:20.434 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-08-09T14:29:20.888 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:20.894 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:20.894 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:20.896 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:23.561 INFO:teuthology.orchestra.run.smithi005.stdout:generic/080 2s 2023-08-09T14:29:23.575 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/080 2023-08-09T14:29:23.575 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:23.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:23.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:23.647 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-08-09T14:29:24.059 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:24.071 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:24.072 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:24.074 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:24.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:24.653 INFO:teuthology.orchestra.run.smithi005.stdout:generic/081 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:29:24.663 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/081 2023-08-09T14:29:24.663 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/081 2023-08-09T14:29:24.664 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:24.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:24.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:24.703 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-08-09T14:29:25.106 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:25.110 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:25.110 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:25.114 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:25.639 INFO:teuthology.orchestra.run.smithi005.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-09T14:29:25.643 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/082 2023-08-09T14:29:25.644 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/082 2023-08-09T14:29:25.644 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:25.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:25.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-08-09T14:29:26.108 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:26.112 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:26.113 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:26.117 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:26.674 INFO:teuthology.orchestra.run.smithi005.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-09T14:29:26.678 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/083 2023-08-09T14:29:26.678 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/083 2023-08-09T14:29:26.679 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:29:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:29:26.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:29:26.711 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-08-09T14:29:27.214 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:29:27.228 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:29:27.228 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:29:27.229 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:29:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:30:33.898 INFO:tasks.ceph.mds.c.smithi005.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f9a1f49b700 time 2023-08-09T14:30:33.897704+0000 2023-08-09T14:30:33.898 INFO:tasks.ceph.mds.c.smithi005.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-09T14:30:33.899 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.900 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9a2ad55e6b] 2023-08-09T14:30:33.900 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.900 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.900 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.900 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.901 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: clone() 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-08-09T14:30:33.899+0000 7f9a1f49b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f9a1f49b700 time 2023-08-09T14:30:33.897704+0000 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-09T14:30:33.902 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9a2ad55e6b] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.903 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.904 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.905 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.905 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: clone() 2023-08-09T14:30:33.905 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.905 INFO:tasks.ceph.mds.c.smithi005.stderr:*** Caught signal (Aborted) ** 2023-08-09T14:30:33.905 INFO:tasks.ceph.mds.c.smithi005.stderr: in thread 7f9a1f49b700 thread_name:ms_dispatch 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9a29b06ce0] 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: gsignal() 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: abort() 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9a2ad55ec5] 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.906 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.907 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 18: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: 19: clone() 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-08-09T14:30:33.901+0000 7f9a1f49b700 -1 *** Caught signal (Aborted) ** 2023-08-09T14:30:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr: in thread 7f9a1f49b700 thread_name:ms_dispatch 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9a29b06ce0] 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: gsignal() 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: abort() 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9a2ad55ec5] 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.909 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.910 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 18: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 19: clone() 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-09T14:30:33.911 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.917 INFO:tasks.ceph.mds.c.smithi005.stderr: -4> 2023-08-09T14:30:33.899+0000 7f9a1f49b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f9a1f49b700 time 2023-08-09T14:30:33.897704+0000 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9a2ad55e6b] 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.918 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.919 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: clone() 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: 0> 2023-08-09T14:30:33.901+0000 7f9a1f49b700 -1 *** Caught signal (Aborted) ** 2023-08-09T14:30:33.920 INFO:tasks.ceph.mds.c.smithi005.stderr: in thread 7f9a1f49b700 thread_name:ms_dispatch 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9a29b06ce0] 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: gsignal() 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: abort() 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9a2ad55ec5] 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.921 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.922 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 18: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 19: clone() 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-09T14:30:33.923 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: -4> 2023-08-09T14:30:33.899+0000 7f9a1f49b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f9a1f49b700 time 2023-08-09T14:30:33.897704+0000 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-5389-g668a86f2/rpm/el8/BUILD/ceph-18.0.0-5389-g668a86f2/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9a2ad55e6b] 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.929 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.930 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: clone() 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.931 INFO:tasks.ceph.mds.c.smithi005.stderr: 0> 2023-08-09T14:30:33.901+0000 7f9a1f49b700 -1 *** Caught signal (Aborted) ** 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: in thread 7f9a1f49b700 thread_name:ms_dispatch 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: ceph version 18.0.0-5389-g668a86f2 (668a86f232c9454b2ce5928d1432a29a72964d85) reef (dev) 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9a29b06ce0] 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: 2: gsignal() 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: 3: abort() 2023-08-09T14:30:33.932 INFO:tasks.ceph.mds.c.smithi005.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9a2ad55ec5] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ac031) [0x7f9a2ad56031] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 6: (CInode::auth_unpin(void*)+0x2de) [0x55e90ca5423e] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 7: (MutationImpl::drop_local_auth_pins()+0x39) [0x55e90c873519] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 8: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55e90c8db726] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 9: (Server::journal_close_session(Session*, int, Context*)+0x5b0) [0x55e90c7e7590] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 10: (Server::handle_client_session(boost::intrusive_ptr const&)+0x192f) [0x55e90c81560f] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x100) [0x55e90c842050] 2023-08-09T14:30:33.933 INFO:tasks.ceph.mds.c.smithi005.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55e90c7438f3] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e90c743eec] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55e90c72de2f] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9a2afd4018] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 16: (DispatchQueue::entry()+0x51f) [0x7f9a2afd119f] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9a2b098a51] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 18: /lib64/libpthread.so.0(+0x81cf) [0x7f9a29afc1cf] 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: 19: clone() 2023-08-09T14:30:33.934 INFO:tasks.ceph.mds.c.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-09T14:30:33.935 INFO:tasks.ceph.mds.c.smithi005.stderr: 2023-08-09T14:30:35.611 INFO:tasks.ceph.mds.c.smithi005.stderr:daemon-helper: command crashed with signal 6 2023-08-09T14:30:39.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-08-09T14:30:46.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-08-09T14:30:52.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-08-09T14:30:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-08-09T14:30:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: stdin: file size changed while zipping 2023-08-09T14:30:58.535 INFO:teuthology.orchestra.run.smithi005.stdout:generic/084 91s 2023-08-09T14:30:58.540 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/084 2023-08-09T14:30:58.541 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:30:58.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:30:58.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:30:58.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-08-09T14:30:58.721 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:58.724 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:58.782 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:58.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:58.788 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:58.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:58.789 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-08-09T14:30:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:58.959 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.017 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:59.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:59.026 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:59.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:59.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-08-09T14:30:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.177 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.234 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:59.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:59.238 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:59.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:59.239 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-08-09T14:30:59.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-08-09T14:30:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.409 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.479 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:59.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:59.481 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:59.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:59.482 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-08-09T14:30:59.631 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.634 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:59.688 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:59.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:59.696 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:59.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:59.697 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-08-09T14:30:59.847 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.851 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:30:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:30:59.908 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:30:59.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:30:59.912 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:30:59.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:30:59.913 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-08-09T14:31:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:31:00.078 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:31:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:31:00.128 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:31:00.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:31:00.134 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:31:00.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:31:00.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-08-09T14:31:00.281 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:31:00.285 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: retrying test device mount with external set 2023-08-09T14:31:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:mount error: no mds server is up or the cluster is laggy 2023-08-09T14:31:00.342 INFO:teuthology.orchestra.run.smithi005.stdout:common/rc: could not mount 172.21.15.5:6789:/test on /tmp/tmp.ZQC68Dfhh8test 2023-08-09T14:31:00.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:31:00.349 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-09T14:31:00.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-09T14:31:00.350 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-08-09T14:31:00.940 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:00.944 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:00.945 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:00.946 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:00.946 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:01.499 INFO:teuthology.orchestra.run.smithi005.stdout:generic/093 0s 2023-08-09T14:31:01.504 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/093 2023-08-09T14:31:01.504 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:01.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:01.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:01.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-08-09T14:31:02.082 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:02.085 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:02.086 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:02.087 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:02.474 INFO:teuthology.orchestra.run.smithi005.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-09T14:31:02.479 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/094 2023-08-09T14:31:02.479 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/094 2023-08-09T14:31:02.479 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:02.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:02.821 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-08-09T14:31:03.065 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:03.073 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:03.074 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:03.074 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:05.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-08-09T14:31:12.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-08-09T14:31:16.147 INFO:teuthology.orchestra.run.smithi005.stdout:generic/095 13s 2023-08-09T14:31:16.155 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/095 2023-08-09T14:31:16.156 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:16.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:16.168 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-08-09T14:31:16.392 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:16.396 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:16.397 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:16.398 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:16.819 INFO:teuthology.orchestra.run.smithi005.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-09T14:31:16.823 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/096 2023-08-09T14:31:16.824 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/096 2023-08-09T14:31:16.824 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:16.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:16.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-08-09T14:31:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:17.091 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:17.091 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:17.092 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:17.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:generic/097 0s 2023-08-09T14:31:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/097 2023-08-09T14:31:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:17.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:17.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:17.933 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-08-09T14:31:18.153 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:18.157 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:18.158 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:18.158 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:18.159 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:19.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-08-09T14:31:19.757 INFO:teuthology.orchestra.run.smithi005.stdout:generic/098 1s 2023-08-09T14:31:19.761 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/098 2023-08-09T14:31:19.762 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:19.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:19.772 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-08-09T14:31:19.996 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:20.000 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:20.001 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:20.001 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:20.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:20.882 INFO:teuthology.orchestra.run.smithi005.stdout:generic/099 0s 2023-08-09T14:31:20.887 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/099 2023-08-09T14:31:20.888 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:21.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:21.249 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-08-09T14:31:21.496 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:21.500 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:21.501 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:21.502 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:25.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-08-09T14:31:27.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:31:27.767 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:31:32.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~53s 2023-08-09T14:31:33.094 INFO:teuthology.orchestra.run.smithi005.stdout:generic/100 12s 2023-08-09T14:31:33.099 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/100 2023-08-09T14:31:33.099 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:33.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:36.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:36.970 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-08-09T14:31:37.337 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:37.341 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:37.342 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:37.342 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:37.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:37.691 INFO:teuthology.orchestra.run.smithi005.stdout:generic/101 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:31:37.695 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/101 2023-08-09T14:31:37.695 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/101 2023-08-09T14:31:37.695 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:37.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:37.731 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-08-09T14:31:37.952 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:37.956 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:37.956 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:37.957 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:37.957 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:38.293 INFO:teuthology.orchestra.run.smithi005.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-09T14:31:38.297 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/102 2023-08-09T14:31:38.298 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/102 2023-08-09T14:31:38.298 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:38.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:38.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-08-09T14:31:38.552 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:38.556 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:38.557 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:38.557 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:38.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:38.914 INFO:teuthology.orchestra.run.smithi005.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-09T14:31:38.919 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/103 2023-08-09T14:31:38.919 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/103 2023-08-09T14:31:38.920 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:39.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2023-08-09T14:31:39.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:39.272 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-08-09T14:31:39.511 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:39.801 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:39.801 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:39.801 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:39.909 INFO:teuthology.orchestra.run.smithi005.stdout:generic/104 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:31:39.913 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/104 2023-08-09T14:31:39.913 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/104 2023-08-09T14:31:39.913 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:39.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:39.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-08-09T14:31:40.164 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:40.168 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:40.169 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:40.170 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:41.068 INFO:teuthology.orchestra.run.smithi005.stdout:generic/105 1s 2023-08-09T14:31:41.093 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/105 2023-08-09T14:31:41.093 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:41.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:41.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:41.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-08-09T14:31:41.347 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:41.351 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:41.351 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:41.352 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:41.353 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:41.706 INFO:teuthology.orchestra.run.smithi005.stdout:generic/106 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:31:41.711 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/106 2023-08-09T14:31:41.711 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/106 2023-08-09T14:31:41.711 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:41.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:41.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:41.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-08-09T14:31:41.962 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:41.966 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:41.967 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:41.967 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:41.968 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:42.323 INFO:teuthology.orchestra.run.smithi005.stdout:generic/107 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:31:42.327 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/107 2023-08-09T14:31:42.327 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/107 2023-08-09T14:31:42.327 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:42.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:42.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-08-09T14:31:42.586 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:42.590 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:42.591 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:42.592 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:42.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:43.058 INFO:teuthology.orchestra.run.smithi005.stdout:generic/108 [not run] require 172.21.15.5:6789:/scratch to be valid block disk 2023-08-09T14:31:43.062 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/108 2023-08-09T14:31:43.062 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/108 2023-08-09T14:31:43.062 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:43.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:43.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:43.087 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-08-09T14:31:43.311 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:43.315 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:43.315 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:43.318 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:45.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~66s 2023-08-09T14:31:52.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~73s 2023-08-09T14:31:53.608 INFO:teuthology.orchestra.run.smithi005.stdout:generic/109 10s 2023-08-09T14:31:53.664 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/109 2023-08-09T14:31:53.665 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:31:53.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:53.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:31:53.675 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-08-09T14:31:54.561 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:31:54.565 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:31:54.565 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:31:54.566 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:31:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:31:57.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:31:57.878 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:31:58.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~79s 2023-08-09T14:32:05.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-08-09T14:32:12.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~93s 2023-08-09T14:32:14.671 INFO:teuthology.orchestra.run.smithi005.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:32:14.675 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/110 2023-08-09T14:32:14.675 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/110 2023-08-09T14:32:14.676 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:14.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:15.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:15.039 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-08-09T14:32:15.659 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:15.663 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:15.664 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:15.665 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:32:16.044 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/111 2023-08-09T14:32:16.044 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/111 2023-08-09T14:32:16.044 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:16.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:16.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-08-09T14:32:16.621 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:16.625 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:16.626 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:16.627 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:18.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~99s 2023-08-09T14:32:25.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-08-09T14:32:28.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:32:28.271 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:32:31.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~112s 2023-08-09T14:32:32.574 INFO:teuthology.orchestra.run.smithi005.stdout:generic/112 16s 2023-08-09T14:32:32.633 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/112 2023-08-09T14:32:32.633 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:32.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:32.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:32.968 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-08-09T14:32:33.238 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:33.242 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:33.243 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:33.244 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:33.244 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:38.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-08-09T14:32:45.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-08-09T14:32:48.063 INFO:teuthology.orchestra.run.smithi005.stdout:generic/113 15s 2023-08-09T14:32:48.068 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/113 2023-08-09T14:32:48.068 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:48.070 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:48.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:48.283 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-08-09T14:32:48.639 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:48.643 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:48.643 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:48.644 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:48.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:49.204 INFO:teuthology.orchestra.run.smithi005.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-08-09T14:32:49.208 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/114 2023-08-09T14:32:49.208 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/114 2023-08-09T14:32:49.208 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:49.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:49.236 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-08-09T14:32:49.454 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:49.458 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:49.459 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:49.460 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:49.460 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:49.817 INFO:teuthology.orchestra.run.smithi005.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:32:49.821 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/115 2023-08-09T14:32:49.821 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/115 2023-08-09T14:32:49.822 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:49.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:50.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:50.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-08-09T14:32:50.422 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:50.427 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:50.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:32:50.794 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/116 2023-08-09T14:32:50.794 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/116 2023-08-09T14:32:50.794 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:32:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:51.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:32:51.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-08-09T14:32:51.373 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:32:51.377 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:32:51.378 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:32:51.379 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:32:51.379 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:32:51.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~132s 2023-08-09T14:32:58.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:32:58.337 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:32:58.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~139s 2023-08-09T14:33:04.753 INFO:teuthology.orchestra.run.smithi005.stdout:generic/117 13s 2023-08-09T14:33:04.758 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/117 2023-08-09T14:33:04.758 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:04.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:04.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:04.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-08-09T14:33:04.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-08-09T14:33:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:05.011 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:05.011 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:05.012 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:05.702 INFO:teuthology.orchestra.run.smithi005.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:33:05.706 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/118 2023-08-09T14:33:05.706 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/118 2023-08-09T14:33:05.706 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:05.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:06.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:06.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-08-09T14:33:06.377 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:06.382 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:06.382 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:06.383 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:06.383 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:06.719 INFO:teuthology.orchestra.run.smithi005.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-08-09T14:33:06.723 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/119 2023-08-09T14:33:06.723 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/119 2023-08-09T14:33:06.723 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:07.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:07.037 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-08-09T14:33:07.311 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:07.315 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:07.316 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:07.316 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:07.317 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:07.648 INFO:teuthology.orchestra.run.smithi005.stdout:generic/120 [not run] atime not maintained by ceph 2023-08-09T14:33:07.652 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/120 2023-08-09T14:33:07.652 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/120 2023-08-09T14:33:07.652 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:07.654 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:07.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:07.672 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-08-09T14:33:07.896 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:07.900 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:07.900 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:07.901 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:07.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:08.250 INFO:teuthology.orchestra.run.smithi005.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-09T14:33:08.254 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/121 2023-08-09T14:33:08.255 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/121 2023-08-09T14:33:08.255 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:08.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:08.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-08-09T14:33:08.826 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:08.831 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:08.831 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:08.832 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:09.188 INFO:teuthology.orchestra.run.smithi005.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-09T14:33:09.193 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/122 2023-08-09T14:33:09.193 INFO:teuthology.orchestra.run.smithi005.stdout:Not run: generic/122 2023-08-09T14:33:09.193 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:09.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:09.548 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-08-09T14:33:09.792 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:09.796 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:09.797 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:09.798 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:09.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:10.290 INFO:teuthology.orchestra.run.smithi005.stdout:generic/123 1s 2023-08-09T14:33:10.295 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/123 2023-08-09T14:33:10.295 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:10.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:10.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-08-09T14:33:10.880 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:10.885 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:10.889 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:10.890 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:10.890 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:11.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~152s 2023-08-09T14:33:13.169 INFO:teuthology.orchestra.run.smithi005.stdout:generic/124 2s 2023-08-09T14:33:13.177 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/124 2023-08-09T14:33:13.177 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:33:13.180 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:13.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:33:13.685 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-08-09T14:33:13.981 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:33:13.985 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:33:13.986 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:33:13.987 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:33:13.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:33:18.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~159s 2023-08-09T14:33:24.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-08-09T14:33:28.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:33:28.481 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:33:31.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~172s 2023-08-09T14:33:38.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~179s 2023-08-09T14:33:44.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-08-09T14:33:51.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~192s 2023-08-09T14:33:57.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~198s 2023-08-09T14:33:58.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:33:58.583 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:34:04.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-08-09T14:34:11.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~212s 2023-08-09T14:34:15.549 INFO:teuthology.orchestra.run.smithi005.stdout:generic/125 61s 2023-08-09T14:34:15.554 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/125 2023-08-09T14:34:15.555 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:34:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:34:15.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:34:15.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-08-09T14:34:16.142 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:34:16.146 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:34:16.146 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:34:16.147 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:34:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:34:16.631 INFO:teuthology.orchestra.run.smithi005.stdout:generic/126 0s 2023-08-09T14:34:16.636 INFO:teuthology.orchestra.run.smithi005.stdout:Ran: generic/126 2023-08-09T14:34:16.636 INFO:teuthology.orchestra.run.smithi005.stdout:Passed all 1 tests 2023-08-09T14:34:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:34:16.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-09T14:34:16.981 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/tmp.cj6W3QcazExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-08-09T14:34:17.252 INFO:teuthology.orchestra.run.smithi005.stdout:FSTYP -- ceph 2023-08-09T14:34:17.256 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM -- Linux/x86_64 smithi005 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-09T14:34:17.257 INFO:teuthology.orchestra.run.smithi005.stdout:MKFS_OPTIONS -- 172.21.15.5:6789:/scratch 2023-08-09T14:34:17.258 INFO:teuthology.orchestra.run.smithi005.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBLn9Nkhrv1KhAAH4KRqM9FcLOjCHbM7iGHUQ== -o context=system_u:object_r:root_t:s0 172.21.15.5:6789:/scratch /tmp/tmp.rWxkiyh4p5scratch 2023-08-09T14:34:17.258 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:34:17.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~218s 2023-08-09T14:34:24.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-08-09T14:34:28.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:34:28.658 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:34:30.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~231s 2023-08-09T14:34:37.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~238s 2023-08-09T14:34:44.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-08-09T14:34:50.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~251s 2023-08-09T14:34:57.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~258s 2023-08-09T14:34:58.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:34:58.761 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:35:03.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~264s 2023-08-09T14:35:10.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~271s 2023-08-09T14:35:17.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~278s 2023-08-09T14:35:23.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~284s 2023-08-09T14:35:28.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:35:28.836 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:35:30.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~291s 2023-08-09T14:35:37.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~298s 2023-08-09T14:35:43.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~304s 2023-08-09T14:35:43.664 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-08-09T14:35:43.664 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:35:43.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:35:43.683 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:35:43.683 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:35:43.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T14:35:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.920+0000 7ff6628f3700 1 Processor -- start 2023-08-09T14:35:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.920+0000 7ff6628f3700 1 -- start start 2023-08-09T14:35:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff6628f3700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7ff65c0cdea0 0x7ff65c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff6628f3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 0x7ff65c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff6628f3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0cfc10 con 0x7ff65c15e750 2023-08-09T14:35:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff6628f3700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0cf000 con 0x7ff65c0cdea0 2023-08-09T14:35:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff6628f3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0cf2e0 con 0x7ff65c0cea90 2023-08-09T14:35:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff65bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff65c15e750 0x7ff65c0cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60498/0 (socket says 172.21.15.5:60498) 2023-08-09T14:35:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff65bfff700 1 -- 172.21.15.5:0/2212526886 learned_addr learned my addr 172.21.15.5:0/2212526886 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:35:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff660e90700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 0x7ff65c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.921+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2212526886 >> v2:172.21.15.101:3300/0 conn(0x7ff65c0cdea0 0x7ff65c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503324755 0 0) 0x7ff65c0cfc10 con 0x7ff65c15e750 2023-08-09T14:35:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6440035b0 con 0x7ff65c15e750 2023-08-09T14:35:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018252211 0 0) 0x7ff6440035b0 con 0x7ff65c15e750 2023-08-09T14:35:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65b7fe700 1 -- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 msgr2=0x7ff65c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 0x7ff65c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65b7fe700 1 -- 172.21.15.5:0/2212526886 >> v1:172.21.15.5:6789/0 conn(0x7ff65c15e750 legacy=0x7ff65c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65b7fe700 1 -- 172.21.15.5:0/2212526886 --> v2:172.21.15.101:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0cf5c0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff660e90700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 0x7ff65c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b3d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff650009840 tx=0x7ff650009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74a6a6e6ffd0ed3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 <== mon.1 v2:172.21.15.101:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c001670 con 0x7ff65c0cdea0 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 <== mon.1 v2:172.21.15.101:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650004030 con 0x7ff65c0cdea0 2023-08-09T14:35:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.922+0000 7ff65affd700 1 -- 172.21.15.5:0/2212526886 <== mon.1 v2:172.21.15.101:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500043c0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 -- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cdea0 msgr2=0x7ff65c0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b3d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff650009840 tx=0x7ff650009b50 comp rx=0 tx=0).stop 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 -- 172.21.15.5:0/2212526886 shutdown_connections 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c0cea90 0x7ff65c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2212526886 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b3d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 -- 172.21.15.5:0/2212526886 >> 172.21.15.5:0/2212526886 conn(0x7ff65c09a180 msgr2=0x7ff65c0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 -- 172.21.15.5:0/2212526886 shutdown_connections 2023-08-09T14:35:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.923+0000 7ff6628f3700 1 -- 172.21.15.5:0/2212526886 wait complete. 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.925+0000 7ff6628f3700 1 Processor -- start 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.925+0000 7ff6628f3700 1 -- start start 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cea90 0x7ff65c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c15e750 0x7ff65c150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b50d0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b54f0 con 0x7ff65c0cea90 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff6628f3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b4450 con 0x7ff65c15e750 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.926+0000 7ff65bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47088/0 (socket says 172.21.15.5:47088) 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 -- 172.21.15.5:0/2779676173 learned_addr learned my addr 172.21.15.5:0/2779676173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cea90 0x7ff65c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff660e90700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c15e750 0x7ff65c150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 -- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c15e750 msgr2=0x7ff65c150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c15e750 0x7ff65c150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 -- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cea90 msgr2=0x7ff65c0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cea90 0x7ff65c0b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 -- 172.21.15.5:0/2779676173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009a70 con 0x7ff65c0cdea0 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff65bfff700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c780 tx=0x7ff64c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c004c80 con 0x7ff65c0cdea0 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c004de0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0072f0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6500094a0 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.927+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c0b4a10 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.929+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0b5340 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.929+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff64c007450 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.929+0000 7ff658ff9700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 0x7ff64806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.930+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff64c088290 con 0x7ff65c0cdea0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.930+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 0x7ff64806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.930+0000 7ff65b7fe700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 0x7ff64806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6500090b0 tx=0x7ff650008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:43.935+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff64c053880 con 0x7ff65c0cdea0 2023-08-09T14:35:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.174+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff65c074600 con 0x7ff65c0cdea0 2023-08-09T14:35:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.175+0000 7ff658ff9700 1 -- 172.21.15.5:0/2779676173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18421 (secure 0 0 0) 0x7ff64c007700 con 0x7ff65c0cdea0 2023-08-09T14:35:44.177 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-08-09T14:35:44.177 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"59d7238d-6ce2-4e7c-9329-64c716150f65","created":"2023-08-09T14:15:08.136578+0000","modified":"2023-08-09T14:30:48.258012+0000","last_up_change":"2023-08-09T14:15:18.950651+0000","last_in_change":"2023-08-09T14:15:10.589330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-09T14:15:19.438027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-09T14:15:19.836788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T14:16:25.137999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T14:16:25.743028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e91ea65-7cc6-4af4-abf6-72c86b4ed85e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6801","nonce":2789981148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6803","nonce":2789981148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6807","nonce":2789981148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2789981148},{"type":"v1","addr":"172.21.15.5:6805","nonce":2789981148}]},"public_addr":"172.21.15.5:6801/2789981148","cluster_addr":"172.21.15.5:6803/2789981148","heartbeat_back_addr":"172.21.15.5:6807/2789981148","heartbeat_front_addr":"172.21.15.5:6805/2789981148","state":["exists","up"]},{"osd":1,"uuid":"3b264185-cb76-4cc6-b71e-aa059ee47a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6810","nonce":2174485398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6814","nonce":2174485398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6821","nonce":2174485398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2174485398},{"type":"v1","addr":"172.21.15.5:6817","nonce":2174485398}]},"public_addr":"172.21.15.5:6810/2174485398","cluster_addr":"172.21.15.5:6814/2174485398","heartbeat_back_addr":"172.21.15.5:6821/2174485398","heartbeat_front_addr":"172.21.15.5:6817/2174485398","state":["exists","up"]},{"osd":2,"uuid":"24133eef-ab37-45a0-89b5-826847465f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6825","nonce":4031924117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6827","nonce":4031924117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6831","nonce":4031924117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4031924117},{"type":"v1","addr":"172.21.15.5:6829","nonce":4031924117}]},"public_addr":"172.21.15.5:6825/4031924117","cluster_addr":"172.21.15.5:6827/4031924117","heartbeat_back_addr":"172.21.15.5:6831/4031924117","heartbeat_front_addr":"172.21.15.5:6829/4031924117","state":["exists","up"]},{"osd":3,"uuid":"44082c38-6061-4073-8974-5cd82e524f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6811","nonce":2836163092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6815","nonce":2836163092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6823","nonce":2836163092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2836163092},{"type":"v1","addr":"172.21.15.5:6820","nonce":2836163092}]},"public_addr":"172.21.15.5:6811/2836163092","cluster_addr":"172.21.15.5:6815/2836163092","heartbeat_back_addr":"172.21.15.5:6823/2836163092","heartbeat_front_addr":"172.21.15.5:6820/2836163092","state":["exists","up"]},{"osd":4,"uuid":"161d5ace-3e03-4dda-8f66-bedfe3793e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6816","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6817","nonce":3814712948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6820","nonce":3814712948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6828","nonce":3814712948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":3814712948},{"type":"v1","addr":"172.21.15.101:6824","nonce":3814712948}]},"public_addr":"172.21.15.101:6817/3814712948","cluster_addr":"172.21.15.101:6820/3814712948","heartbeat_back_addr":"172.21.15.101:6828/3814712948","heartbeat_front_addr":"172.21.15.101:6824/3814712948","state":["exists","up"]},{"osd":5,"uuid":"79bf2d03-0373-4431-8e63-28fe26b387a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6801","nonce":2298841735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6803","nonce":2298841735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6807","nonce":2298841735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":2298841735},{"type":"v1","addr":"172.21.15.101:6805","nonce":2298841735}]},"public_addr":"172.21.15.101:6801/2298841735","cluster_addr":"172.21.15.101:6803/2298841735","heartbeat_back_addr":"172.21.15.101:6807/2298841735","heartbeat_front_addr":"172.21.15.101:6805/2298841735","state":["exists","up"]},{"osd":6,"uuid":"0cabf2c3-6e8f-4a43-a45f-36a4cd5ea544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6809","nonce":3445198555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6811","nonce":3445198555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6815","nonce":3445198555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":3445198555},{"type":"v1","addr":"172.21.15.101:6813","nonce":3445198555}]},"public_addr":"172.21.15.101:6809/3445198555","cluster_addr":"172.21.15.101:6811/3445198555","heartbeat_back_addr":"172.21.15.101:6815/3445198555","heartbeat_front_addr":"172.21.15.101:6813/3445198555","state":["exists","up"]},{"osd":7,"uuid":"11296481-9850-4980-adf4-bc61eebe2a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6821","nonce":483537661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6823","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6825","nonce":483537661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6831","nonce":483537661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6827","nonce":483537661},{"type":"v1","addr":"172.21.15.101:6829","nonce":483537661}]},"public_addr":"172.21.15.101:6821/483537661","cluster_addr":"172.21.15.101:6825/483537661","heartbeat_back_addr":"172.21.15.101:6831/483537661","heartbeat_front_addr":"172.21.15.101:6829/483537661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.751042+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.753431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.499601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.801537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.816231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.785393+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.815138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T14:15:15.773089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/3709637189":"2023-08-10T14:30:48.257956+0000","172.21.15.5:6832/3709637189":"2023-08-10T14:30:48.257956+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T14:35:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.177+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 msgr2=0x7ff64806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.177+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 0x7ff64806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6500090b0 tx=0x7ff650008030 comp rx=0 tx=0).stop 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.177+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 msgr2=0x7ff65c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.177+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c780 tx=0x7ff64c00ca90 comp rx=0 tx=0).stop 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 shutdown_connections 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff64806a0e0 0x7ff64806c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff65c15e750 0x7ff65c150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65c0cdea0 0x7ff65c0b5920 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 --2- 172.21.15.5:0/2779676173 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff65c0cea90 0x7ff65c0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 >> 172.21.15.5:0/2779676173 conn(0x7ff65c09a180 msgr2=0x7ff65c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 shutdown_connections 2023-08-09T14:35:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.178+0000 7ff6628f3700 1 -- 172.21.15.5:0/2779676173 wait complete. 2023-08-09T14:35:44.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-09T14:15:19.438027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-09T14:15:19.836788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T14:16:25.137999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T14:16:25.743028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T14:35:44.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T14:35:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.339+0000 7fb5e29f8700 1 Processor -- start 2023-08-09T14:35:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.339+0000 7fb5e29f8700 1 -- start start 2023-08-09T14:35:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e29f8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 0x7fb5dc0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e29f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0cb2d0 con 0x7fb5dc0ce410 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e29f8700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0cb5b0 con 0x7fb5dc159e90 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e29f8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0cb890 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e0f95700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5dc0ce410 0x7fb5dc0cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60516/0 (socket says 172.21.15.5:60516) 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.340+0000 7fb5e0f95700 1 -- 172.21.15.5:0/2763476154 learned_addr learned my addr 172.21.15.5:0/2763476154 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5db7fe700 1 --2- 172.21.15.5:0/2763476154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 0x7fb5dc0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790915240 0 0) 0x7fb5dc0cb2d0 con 0x7fb5dc0ce410 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c40035b0 con 0x7fb5dc0ce410 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272569913 0 0) 0x7fb5dc0cb5b0 con 0x7fb5dc159e90 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 --> v1:172.21.15.101:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5dc0cb2d0 con 0x7fb5dc159e90 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5db7fe700 1 -- 172.21.15.5:0/2763476154 >> v1:172.21.15.101:6789/0 conn(0x7fb5dc159e90 legacy=0x7fb5dc06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5db7fe700 1 -- 172.21.15.5:0/2763476154 >> v1:172.21.15.5:6789/0 conn(0x7fb5dc0ce410 legacy=0x7fb5dc0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5db7fe700 1 -- 172.21.15.5:0/2763476154 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0cbb70 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5db7fe700 1 --2- 172.21.15.5:0/2763476154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 0x7fb5dc0cacd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe0a5f343de60cb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0004230 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0004390 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.341+0000 7fb5daffd700 1 -- 172.21.15.5:0/2763476154 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00036a0 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 -- 172.21.15.5:0/2763476154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 msgr2=0x7fb5dc0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/2763476154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 0x7fb5dc0cacd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d0009b80 comp rx=0 tx=0).stop 2023-08-09T14:35:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 -- 172.21.15.5:0/2763476154 shutdown_connections 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/2763476154 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0b2c70 0x7fb5dc0cacd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 -- 172.21.15.5:0/2763476154 >> 172.21.15.5:0/2763476154 conn(0x7fb5dc0b1970 msgr2=0x7fb5dc0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 -- 172.21.15.5:0/2763476154 shutdown_connections 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.342+0000 7fb5e29f8700 1 -- 172.21.15.5:0/2763476154 wait complete. 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.344+0000 7fb5e29f8700 1 Processor -- start 2023-08-09T14:35:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.344+0000 7fb5e29f8700 1 -- start start 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb5dc0b2c70 0x7fb5dc14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0ce410 0x7fb5dc14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc14f760 con 0x7fb5dc159e90 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1599f0 con 0x7fb5dc0b2c70 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e29f8700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc158de0 con 0x7fb5dc0ce410 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47106/0 (socket says 172.21.15.5:47106) 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 -- 172.21.15.5:0/880044647 learned_addr learned my addr 172.21.15.5:0/880044647 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5dbfff700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb5dc0b2c70 0x7fb5dc14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5db7fe700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0ce410 0x7fb5dc14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 -- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0ce410 msgr2=0x7fb5dc14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0ce410 0x7fb5dc14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 -- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb5dc0b2c70 msgr2=0x7fb5dc14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb5dc0b2c70 0x7fb5dc14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 -- 172.21.15.5:0/880044647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00094a0 con 0x7fb5dc159e90 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5e0f95700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400cb70 tx=0x7fb5d400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.345+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400aa60 con 0x7fb5dc159e90 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.346+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400abc0 con 0x7fb5dc159e90 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.346+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc1590c0 con 0x7fb5dc159e90 2023-08-09T14:35:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.346+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4012400 con 0x7fb5dc159e90 2023-08-09T14:35:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.346+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc159680 con 0x7fb5dc159e90 2023-08-09T14:35:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.347+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0c7710 con 0x7fb5dc159e90 2023-08-09T14:35:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.347+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5d40113a0 con 0x7fb5dc159e90 2023-08-09T14:35:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.347+0000 7fb5d8ff9700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 0x7fb5c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.347+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fb5d40881c0 con 0x7fb5dc159e90 2023-08-09T14:35:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.348+0000 7fb5dbfff700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 0x7fb5c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.348+0000 7fb5dbfff700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 0x7fb5c806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000f60 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.353+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb5dc0c7710 con 0x7fb5dc159e90 2023-08-09T14:35:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.590+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5dc0c76f0 con 0x7fb5dc159e90 2023-08-09T14:35:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.590+0000 7fb5d8ff9700 1 -- 172.21.15.5:0/880044647 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5d40538c0 con 0x7fb5dc159e90 2023-08-09T14:35:44.592 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.592+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 msgr2=0x7fb5c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.592+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 0x7fb5c806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000f60 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.592+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 msgr2=0x7fb5dc14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.592+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400cb70 tx=0x7fb5d400ce80 comp rx=0 tx=0).stop 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 shutdown_connections 2023-08-09T14:35:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7fb5c806a0e0 0x7fb5c806c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc159e90 0x7fb5dc14f220 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7fb5dc0b2c70 0x7fb5dc14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 --2- 172.21.15.5:0/880044647 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7fb5dc0ce410 0x7fb5dc14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 >> 172.21.15.5:0/880044647 conn(0x7fb5dc0b1970 msgr2=0x7fb5dc071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 shutdown_connections 2023-08-09T14:35:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.593+0000 7fb5e29f8700 1 -- 172.21.15.5:0/880044647 wait complete. 2023-08-09T14:35:44.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T14:35:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.757+0000 7ff1276e3700 1 Processor -- start 2023-08-09T14:35:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.757+0000 7ff1276e3700 1 -- start start 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff1276e3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12015d3a0 0x7ff1200af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff1276e3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff1200cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff1276e3700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200715a0 con 0x7ff12006a1c0 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff1276e3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200cd6c0 con 0x7ff12015d3a0 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff1276e3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200712a0 con 0x7ff1200cd1c0 2023-08-09T14:35:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff12547f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12015d3a0 0x7ff1200af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff12547f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12015d3a0 0x7ff1200af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47110/0 (socket says 172.21.15.5:47110) 2023-08-09T14:35:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.758+0000 7ff12547f700 1 -- 172.21.15.5:0/499420110 learned_addr learned my addr 172.21.15.5:0/499420110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff124c7e700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff1200cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff12547f700 1 -- 172.21.15.5:0/499420110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 msgr2=0x7ff1200cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:35:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff12547f700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff1200cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff12547f700 1 -- 172.21.15.5:0/499420110 >> v1:172.21.15.101:6789/0 conn(0x7ff12006a1c0 legacy=0x7ff120160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff12547f700 1 -- 172.21.15.5:0/499420110 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200cf570 con 0x7ff12015d3a0 2023-08-09T14:35:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff12547f700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200af2c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0098f0 tx=0x7ff11c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01e95432f3bc3ec server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff117fff700 1 -- 172.21.15.5:0/499420110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00b8a0 con 0x7ff12015d3a0 2023-08-09T14:35:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff117fff700 1 -- 172.21.15.5:0/499420110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00ba00 con 0x7ff12015d3a0 2023-08-09T14:35:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.759+0000 7ff117fff700 1 -- 172.21.15.5:0/499420110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00bd90 con 0x7ff12015d3a0 2023-08-09T14:35:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 -- 172.21.15.5:0/499420110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 msgr2=0x7ff1200af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200af2c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0098f0 tx=0x7ff11c009c00 comp rx=0 tx=0).stop 2023-08-09T14:35:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 -- 172.21.15.5:0/499420110 shutdown_connections 2023-08-09T14:35:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200af2c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 --2- 172.21.15.5:0/499420110 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff1200cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 -- 172.21.15.5:0/499420110 >> 172.21.15.5:0/499420110 conn(0x7ff1200b1970 msgr2=0x7ff1200b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 -- 172.21.15.5:0/499420110 shutdown_connections 2023-08-09T14:35:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.760+0000 7ff1276e3700 1 -- 172.21.15.5:0/499420110 wait complete. 2023-08-09T14:35:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.762+0000 7ff1276e3700 1 Processor -- start 2023-08-09T14:35:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.762+0000 7ff1276e3700 1 -- start start 2023-08-09T14:35:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff12006a1c0 0x7ff1201f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff120158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1201f6d10 con 0x7ff12015d3a0 2023-08-09T14:35:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1201593c0 con 0x7ff12006a1c0 2023-08-09T14:35:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff1276e3700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200c78b0 con 0x7ff1200cd1c0 2023-08-09T14:35:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47120/0 (socket says 172.21.15.5:47120) 2023-08-09T14:35:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 -- 172.21.15.5:0/1274739869 learned_addr learned my addr 172.21.15.5:0/1274739869 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff12547f700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff12006a1c0 0x7ff1201f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff124c7e700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff120158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 -- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 msgr2=0x7ff120158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff120158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 -- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff12006a1c0 msgr2=0x7ff1201f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff12006a1c0 0x7ff1201f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.763+0000 7ff125c80700 1 -- 172.21.15.5:0/1274739869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009550 con 0x7ff12015d3a0 2023-08-09T14:35:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff125c80700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff11800cc50 tx=0x7ff11800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118003c00 con 0x7ff12015d3a0 2023-08-09T14:35:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118003d60 con 0x7ff12015d3a0 2023-08-09T14:35:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800aab0 con 0x7ff12015d3a0 2023-08-09T14:35:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200c7b90 con 0x7ff12015d3a0 2023-08-09T14:35:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.764+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200c4660 con 0x7ff12015d3a0 2023-08-09T14:35:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.765+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff11800ac10 con 0x7ff12015d3a0 2023-08-09T14:35:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.766+0000 7ff115ffb700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 0x7ff10406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.766+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff120074600 con 0x7ff12015d3a0 2023-08-09T14:35:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.766+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff118088570 con 0x7ff12015d3a0 2023-08-09T14:35:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.766+0000 7ff12547f700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 0x7ff10406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:44.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.767+0000 7ff12547f700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 0x7ff10406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff11c014040 tx=0x7ff11c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:44.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:44.771+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff118053c70 con 0x7ff12015d3a0 2023-08-09T14:35:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.001+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1200b27c0 con 0x7ff12015d3a0 2023-08-09T14:35:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.001+0000 7ff115ffb700 1 -- 172.21.15.5:0/1274739869 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff118057290 con 0x7ff12015d3a0 2023-08-09T14:35:45.003 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-08-09T14:35:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 msgr2=0x7ff10406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 0x7ff10406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff11c014040 tx=0x7ff11c008030 comp rx=0 tx=0).stop 2023-08-09T14:35:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 msgr2=0x7ff1200add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff11800cc50 tx=0x7ff11800cf60 comp rx=0 tx=0).stop 2023-08-09T14:35:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 shutdown_connections 2023-08-09T14:35:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7ff10406a0e0 0x7ff10406c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12015d3a0 0x7ff1200add80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7ff12006a1c0 0x7ff1201f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 --2- 172.21.15.5:0/1274739869 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7ff1200cd1c0 0x7ff120158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 >> 172.21.15.5:0/1274739869 conn(0x7ff1200b1970 msgr2=0x7ff12006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 shutdown_connections 2023-08-09T14:35:45.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.004+0000 7ff1276e3700 1 -- 172.21.15.5:0/1274739869 wait complete. 2023-08-09T14:35:45.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T14:35:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 Processor -- start 2023-08-09T14:35:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 -- start start 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e400b2ff0 0x7f4e4015f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e400cf500 con 0x7f4e400b6170 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4015c670 con 0x7f4e400cb4b0 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.162+0000 7f4e461f2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4015fc90 con 0x7f4e400b2ff0 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e400b2ff0 0x7f4e4015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e400b6170 0x7f4e400b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60540/0 (socket says 172.21.15.5:60540) 2023-08-09T14:35:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3f7fe700 1 -- 172.21.15.5:0/2931496940 learned_addr learned my addr 172.21.15.5:0/2931496940 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:35:45.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3effd700 1 -- 172.21.15.5:0/2931496940 >> v1:172.21.15.101:6789/0 conn(0x7f4e400cb4b0 legacy=0x7f4e40151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3effd700 1 -- 172.21.15.5:0/2931496940 >> v1:172.21.15.5:6789/0 conn(0x7f4e400b6170 legacy=0x7f4e400b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3effd700 1 -- 172.21.15.5:0/2931496940 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400cb8c0 con 0x7f4e400b2ff0 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3e7fc700 1 -- 172.21.15.5:0/2931496940 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386390516 0 0) 0x7f4e400cf500 con 0x7f4e400b6170 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3effd700 1 --2- 172.21.15.5:0/2931496940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e400b2ff0 0x7f4e4015f640 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009840 tx=0x7f4e34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4b49d7948df3a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3e7fc700 1 -- 172.21.15.5:0/2931496940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34004230 con 0x7f4e400b2ff0 2023-08-09T14:35:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3e7fc700 1 -- 172.21.15.5:0/2931496940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34004390 con 0x7f4e400b2ff0 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.163+0000 7f4e3e7fc700 1 -- 172.21.15.5:0/2931496940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340036a0 con 0x7f4e400b2ff0 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 -- 172.21.15.5:0/2931496940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e400b2ff0 msgr2=0x7f4e4015f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 --2- 172.21.15.5:0/2931496940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e400b2ff0 0x7f4e4015f640 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009840 tx=0x7f4e34009b50 comp rx=0 tx=0).stop 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 -- 172.21.15.5:0/2931496940 shutdown_connections 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 --2- 172.21.15.5:0/2931496940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e400b2ff0 0x7f4e4015f640 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 -- 172.21.15.5:0/2931496940 >> 172.21.15.5:0/2931496940 conn(0x7f4e4006dec0 msgr2=0x7f4e4006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 -- 172.21.15.5:0/2931496940 shutdown_connections 2023-08-09T14:35:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.164+0000 7f4e461f2700 1 -- 172.21.15.5:0/2931496940 wait complete. 2023-08-09T14:35:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.166+0000 7f4e461f2700 1 Processor -- start 2023-08-09T14:35:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.166+0000 7f4e461f2700 1 -- start start 2023-08-09T14:35:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4e400b6170 0x7f4e401540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4e400cb4b0 0x7f4e400b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401f0d60 con 0x7f4e401f41b0 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401f4770 con 0x7f4e400b6170 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e461f2700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401f4a50 con 0x7f4e400cb4b0 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47134/0 (socket says 172.21.15.5:47134) 2023-08-09T14:35:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e3ffff700 1 -- 172.21.15.5:0/3806992096 learned_addr learned my addr 172.21.15.5:0/3806992096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e3f7fe700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4e400b6170 0x7f4e401540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.167+0000 7f4e3effd700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4e400cb4b0 0x7f4e400b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 -- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4e400cb4b0 msgr2=0x7f4e400b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4e400cb4b0 0x7f4e400b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 -- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4e400b6170 msgr2=0x7f4e401540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4e400b6170 0x7f4e401540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 -- 172.21.15.5:0/3806992096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340094a0 con 0x7f4e401f41b0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e3ffff700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b970 tx=0x7f4e3800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800d860 con 0x7f4e401f41b0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800d9c0 con 0x7f4e401f41b0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e401f4d30 con 0x7f4e401f41b0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800dd70 con 0x7f4e401f41b0 2023-08-09T14:35:45.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.168+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e401f5010 con 0x7f4e401f41b0 2023-08-09T14:35:45.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.170+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e400cf970 con 0x7f4e401f41b0 2023-08-09T14:35:45.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.170+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e3800e430 con 0x7f4e401f41b0 2023-08-09T14:35:45.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.170+0000 7f4e27fff700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 0x7f4e2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.170+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4e38088750 con 0x7f4e401f41b0 2023-08-09T14:35:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.171+0000 7f4e3f7fe700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 0x7f4e2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.171+0000 7f4e3f7fe700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 0x7f4e2c06c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e30007b10 tx=0x7f4e30007a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.175+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4e400cf970 con 0x7f4e401f41b0 2023-08-09T14:35:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.406+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e400cf970 con 0x7f4e401f41b0 2023-08-09T14:35:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.406+0000 7f4e27fff700 1 -- 172.21.15.5:0/3806992096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e400cf970 con 0x7f4e401f41b0 2023-08-09T14:35:45.407 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-08-09T14:35:45.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 msgr2=0x7f4e2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 0x7f4e2c06c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e30007b10 tx=0x7f4e30007a60 comp rx=0 tx=0).stop 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 msgr2=0x7f4e400c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b970 tx=0x7f4e3800bc80 comp rx=0 tx=0).stop 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 shutdown_connections 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f4e2c06a0e0 0x7f4e2c06c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e401f41b0 0x7f4e400c4950 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f4e400b6170 0x7f4e401540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 --2- 172.21.15.5:0/3806992096 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f4e400cb4b0 0x7f4e400b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.408+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 >> 172.21.15.5:0/3806992096 conn(0x7f4e4006dec0 msgr2=0x7f4e40155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.409+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 shutdown_connections 2023-08-09T14:35:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.409+0000 7f4e461f2700 1 -- 172.21.15.5:0/3806992096 wait complete. 2023-08-09T14:35:45.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T14:35:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.562+0000 7f541e63f700 1 Processor -- start 2023-08-09T14:35:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.562+0000 7f541e63f700 1 -- start start 2023-08-09T14:35:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f541e63f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f54180af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f541e63f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180715a0 con 0x7f541815d3a0 2023-08-09T14:35:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f541e63f700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180712a0 con 0x7f541806a1c0 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f541e63f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180cd6c0 con 0x7f54180cd1c0 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f5417fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f541815d3a0 0x7f54180cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60554/0 (socket says 172.21.15.5:60554) 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f5417fff700 1 -- 172.21.15.5:0/912608619 learned_addr learned my addr 172.21.15.5:0/912608619 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.563+0000 7f54177fe700 1 --2- 172.21.15.5:0/912608619 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f54180af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195780057 0 0) 0x7f54180715a0 con 0x7f541815d3a0 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54000035b0 con 0x7f541815d3a0 2023-08-09T14:35:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 <== mon.1 v1:172.21.15.101:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251515050 0 0) 0x7f54180712a0 con 0x7f541806a1c0 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f54177fe700 1 -- 172.21.15.5:0/912608619 >> v1:172.21.15.101:6789/0 conn(0x7f541806a1c0 legacy=0x7f5418160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f54177fe700 1 -- 172.21.15.5:0/912608619 >> v1:172.21.15.5:6789/0 conn(0x7f541815d3a0 legacy=0x7f54180cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f54177fe700 1 -- 172.21.15.5:0/912608619 --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180ce110 con 0x7f54180cd1c0 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f54177fe700 1 --2- 172.21.15.5:0/912608619 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f54180af2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f540c009870 tx=0x7f540c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09758951e17301c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 <== mon.2 v2:172.21.15.101:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c011830 con 0x7f54180cd1c0 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 <== mon.2 v2:172.21.15.101:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c011990 con 0x7f54180cd1c0 2023-08-09T14:35:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.564+0000 7f5416ffd700 1 -- 172.21.15.5:0/912608619 <== mon.2 v2:172.21.15.101:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c011d20 con 0x7f54180cd1c0 2023-08-09T14:35:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 -- 172.21.15.5:0/912608619 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 msgr2=0x7f54180af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 --2- 172.21.15.5:0/912608619 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f54180af2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f540c009870 tx=0x7f540c009b80 comp rx=0 tx=0).stop 2023-08-09T14:35:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 -- 172.21.15.5:0/912608619 shutdown_connections 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 --2- 172.21.15.5:0/912608619 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f54180af2c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 -- 172.21.15.5:0/912608619 >> 172.21.15.5:0/912608619 conn(0x7f54180b1970 msgr2=0x7f54180b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 -- 172.21.15.5:0/912608619 shutdown_connections 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.565+0000 7f541e63f700 1 -- 172.21.15.5:0/912608619 wait complete. 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.566+0000 7f541e63f700 1 Processor -- start 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 -- start start 2023-08-09T14:35:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f541814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f541815d3a0 0x7f541814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418149770 con 0x7f541806a1c0 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541814bcd0 con 0x7f541815d3a0 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f541e63f700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541814bfb0 con 0x7f54180cd1c0 2023-08-09T14:35:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.567+0000 7f5417fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47144/0 (socket says 172.21.15.5:47144) 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 -- 172.21.15.5:0/1711568998 learned_addr learned my addr 172.21.15.5:0/1711568998 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f54177fe700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f541814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f541cbdc700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f541815d3a0 0x7f541814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 -- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 msgr2=0x7f541814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f541814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 -- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f541815d3a0 msgr2=0x7f541814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f541815d3a0 0x7f541814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 -- 172.21.15.5:0/1711568998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0094a0 con 0x7f541806a1c0 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5417fff700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f540800c420 tx=0x7f540800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408005d70 con 0x7f541806a1c0 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800ce30 con 0x7f541806a1c0 2023-08-09T14:35:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5418149120 con 0x7f541806a1c0 2023-08-09T14:35:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080072d0 con 0x7f541806a1c0 2023-08-09T14:35:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.568+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54181619a0 con 0x7f541806a1c0 2023-08-09T14:35:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.569+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5418074600 con 0x7f541806a1c0 2023-08-09T14:35:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.570+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5408007430 con 0x7f541806a1c0 2023-08-09T14:35:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.570+0000 7f5414ff9700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 0x7f540406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.570+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5408087810 con 0x7f541806a1c0 2023-08-09T14:35:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.571+0000 7f54177fe700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 0x7f540406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.571+0000 7f54177fe700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 0x7f540406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f540c000c00 tx=0x7f540c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.575+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5408052f30 con 0x7f541806a1c0 2023-08-09T14:35:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.809+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54180b27c0 con 0x7f541806a1c0 2023-08-09T14:35:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.810+0000 7f5414ff9700 1 -- 172.21.15.5:0/1711568998 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5408017020 con 0x7f541806a1c0 2023-08-09T14:35:45.811 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-08-09T14:35:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 msgr2=0x7f540406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 0x7f540406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f540c000c00 tx=0x7f540c008030 comp rx=0 tx=0).stop 2023-08-09T14:35:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 msgr2=0x7f54181487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f540800c420 tx=0x7f540800c730 comp rx=0 tx=0).stop 2023-08-09T14:35:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 shutdown_connections 2023-08-09T14:35:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f540406a0e0 0x7f540406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f541815d3a0 0x7f541814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541806a1c0 0x7f54181487a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 --2- 172.21.15.5:0/1711568998 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f54180cd1c0 0x7f541814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 >> 172.21.15.5:0/1711568998 conn(0x7f54180b1970 msgr2=0x7f541815c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 shutdown_connections 2023-08-09T14:35:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.812+0000 7f541e63f700 1 -- 172.21.15.5:0/1711568998 wait complete. 2023-08-09T14:35:45.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T14:35:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.967+0000 7f5e0466b700 1 Processor -- start 2023-08-09T14:35:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.967+0000 7f5e0466b700 1 -- start start 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e0466b700 1 --2- >> v2:172.21.15.101:3300/0 conn(0x7f5dfc15d490 0x7f5dfc0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e0466b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dfc0b2110 0x7f5dfc0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e0466b700 1 -- --> v1:172.21.15.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0cb640 con 0x7f5dfc0cfc70 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e0466b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cb920 con 0x7f5dfc0b2110 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e0466b700 1 -- --> v2:172.21.15.101:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cbc00 con 0x7f5dfc15d490 2023-08-09T14:35:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dfc0b2110 0x7f5dfc0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dfc0b2110 0x7f5dfc0cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47154/0 (socket says 172.21.15.5:47154) 2023-08-09T14:35:45.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 -- 172.21.15.5:0/3943847178 learned_addr learned my addr 172.21.15.5:0/3943847178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:45.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e02407700 1 --2- 172.21.15.5:0/3943847178 >> v2:172.21.15.101:3300/0 conn(0x7f5dfc15d490 0x7f5dfc0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 -- 172.21.15.5:0/3943847178 >> v2:172.21.15.101:3300/0 conn(0x7f5dfc15d490 msgr2=0x7f5dfc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T14:35:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 --2- 172.21.15.5:0/3943847178 >> v2:172.21.15.101:3300/0 conn(0x7f5dfc15d490 0x7f5dfc0cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 -- 172.21.15.5:0/3943847178 >> v1:172.21.15.101:6789/0 conn(0x7f5dfc0cfc70 legacy=0x7f5dfc0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.968+0000 7f5e01c06700 1 -- 172.21.15.5:0/3943847178 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0cbee0 con 0x7f5dfc0b2110 2023-08-09T14:35:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e01c06700 1 --2- 172.21.15.5:0/3943847178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc0b2110 0x7f5dfc0cf730 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc08b6a0 tx=0x7f5dec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43eaadcb38c669f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e01405700 1 -- 172.21.15.5:0/3943847178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011830 con 0x7f5dfc0b2110 2023-08-09T14:35:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e01405700 1 -- 172.21.15.5:0/3943847178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec011990 con 0x7f5dfc0b2110 2023-08-09T14:35:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e01405700 1 -- 172.21.15.5:0/3943847178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011d20 con 0x7f5dfc0b2110 2023-08-09T14:35:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 -- 172.21.15.5:0/3943847178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc0b2110 msgr2=0x7f5dfc0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 --2- 172.21.15.5:0/3943847178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc0b2110 0x7f5dfc0cf730 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc08b6a0 tx=0x7f5dec009bd0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 -- 172.21.15.5:0/3943847178 shutdown_connections 2023-08-09T14:35:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 --2- 172.21.15.5:0/3943847178 >> v2:172.21.15.101:3300/0 conn(0x7f5dfc15d490 0x7f5dfc0cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 --2- 172.21.15.5:0/3943847178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc0b2110 0x7f5dfc0cf730 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 -- 172.21.15.5:0/3943847178 >> 172.21.15.5:0/3943847178 conn(0x7f5dfc09a180 msgr2=0x7f5dfc0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.969+0000 7f5e0466b700 1 -- 172.21.15.5:0/3943847178 shutdown_connections 2023-08-09T14:35:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.970+0000 7f5e0466b700 1 -- 172.21.15.5:0/3943847178 wait complete. 2023-08-09T14:35:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.971+0000 7f5e0466b700 1 Processor -- start 2023-08-09T14:35:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.971+0000 7f5e0466b700 1 -- start start 2023-08-09T14:35:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 --2- >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5dfc0b2110 0x7f5dfc1e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 --2- >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5dfc0cfc70 0x7f5dfc0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b50f0 con 0x7f5dfc15d490 2023-08-09T14:35:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 -- --> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b53d0 con 0x7f5dfc0cfc70 2023-08-09T14:35:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e0466b700 1 -- --> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b56b0 con 0x7f5dfc0b2110 2023-08-09T14:35:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47160/0 (socket says 172.21.15.5:47160) 2023-08-09T14:35:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 -- 172.21.15.5:0/2811064730 learned_addr learned my addr 172.21.15.5:0/2811064730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-08-09T14:35:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02407700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5dfc0b2110 0x7f5dfc1e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e01c06700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5dfc0cfc70 0x7f5dfc0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 -- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5dfc0b2110 msgr2=0x7f5dfc1e2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5dfc0b2110 0x7f5dfc1e2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 -- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5dfc0cfc70 msgr2=0x7f5dfc0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5dfc0cfc70 0x7f5dfc0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 -- 172.21.15.5:0/2811064730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009550 con 0x7f5dfc15d490 2023-08-09T14:35:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.972+0000 7f5e02c08700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cc50 tx=0x7f5df400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.973+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4003c00 con 0x7f5dfc15d490 2023-08-09T14:35:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.973+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4003d60 con 0x7f5dfc15d490 2023-08-09T14:35:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.973+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400aab0 con 0x7f5dfc15d490 2023-08-09T14:35:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.973+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0b5990 con 0x7f5dfc15d490 2023-08-09T14:35:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.973+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc0b6990 con 0x7f5dfc15d490 2023-08-09T14:35:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.974+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc0b6b80 con 0x7f5dfc15d490 2023-08-09T14:35:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.974+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5df400ac10 con 0x7f5dfc15d490 2023-08-09T14:35:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.975+0000 7f5df2ffd700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 0x7f5de006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T14:35:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.975+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5df4088580 con 0x7f5dfc15d490 2023-08-09T14:35:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.975+0000 7f5e02407700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 0x7f5de006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T14:35:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.976+0000 7f5e02407700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 0x7f5de006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009b40 tx=0x7f5df8009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T14:35:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:45.981+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5df4053bf0 con 0x7f5dfc15d490 2023-08-09T14:35:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.224+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5dfc0b5eb0 con 0x7f5dfc15d490 2023-08-09T14:35:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.224+0000 7f5df2ffd700 1 -- 172.21.15.5:0/2811064730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v37) v1 ==== 80+0+120 (secure 0 0 0) 0x7f5df4057210 con 0x7f5dfc15d490 2023-08-09T14:35:46.225 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/3709637189 2023-08-10T14:30:48.257956+0000 2023-08-09T14:35:46.225 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/3709637189 2023-08-10T14:30:48.257956+0000 2023-08-09T14:35:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 msgr2=0x7f5de006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 0x7f5de006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009b40 tx=0x7f5df8009210 comp rx=0 tx=0).stop 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 msgr2=0x7f5dfc0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cc50 tx=0x7f5df400cf60 comp rx=0 tx=0).stop 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 shutdown_connections 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:6832/892658077,v1:172.21.15.101:6833/892658077] conn(0x7f5de006a0e0 0x7f5de006c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dfc15d490 0x7f5dfc0c84d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3301/0,v1:172.21.15.101:6790/0] conn(0x7f5dfc0b2110 0x7f5dfc1e2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 --2- 172.21.15.5:0/2811064730 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f5dfc0cfc70 0x7f5dfc0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T14:35:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 >> 172.21.15.5:0/2811064730 conn(0x7f5dfc09a180 msgr2=0x7f5dfc0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T14:35:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 shutdown_connections 2023-08-09T14:35:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-08-09T14:35:46.227+0000 7f5e0466b700 1 -- 172.21.15.5:0/2811064730 wait complete. 2023-08-09T14:35:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2023-08-09T14:35:46.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T14:35:46.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:35:46.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-09T14:35:46.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:35:46.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:35:46.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T14:35:46.343 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-08-09T14:35:46.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:35:46.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15768 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.5:6789:/test /tmp/tmp.ZQC68Dfhh8test ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=59d7238d-6ce2-4e7c-9329-64c716150f65,acl 0 0 2023-08-09T14:35:46.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-08-09T14:35:46.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:35:46.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-09T14:35:46.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:35:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-09T14:35:46.460 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:35:46.460 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:35:46.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17790 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-09T14:35:46.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:35:46.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:35:46.482 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T14:35:46.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:35:46.541 INFO:teuthology.orchestra.run.smithi101.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-09T14:35:46.541 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-09T14:35:46.542 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T14:35:46.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17790 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-09T14:35:46.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi101.front.sepia.ceph.com 2023-08-09T14:35:46.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T14:35:46.602 DEBUG:teuthology.orchestra.run.smithi101:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-09T14:35:46.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T14:35:46.660 INFO:teuthology.orchestra.run.smithi101.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-09T14:35:48.269 INFO:tasks.ceph.osd.0:Sent signal 15 2023-08-09T14:35:48.270 INFO:tasks.ceph.osd.1:Sent signal 15 2023-08-09T14:35:48.270 INFO:tasks.ceph.osd.2:Sent signal 15 2023-08-09T14:35:48.271 INFO:tasks.ceph.osd.3:Sent signal 15 2023-08-09T14:35:48.271 INFO:tasks.ceph.osd.4:Sent signal 15 2023-08-09T14:35:48.271 INFO:tasks.ceph.osd.5:Sent signal 15 2023-08-09T14:35:48.272 INFO:tasks.ceph.osd.6:Sent signal 15 2023-08-09T14:35:48.272 INFO:tasks.ceph.osd.7:Sent signal 15 2023-08-09T14:35:48.272 INFO:tasks.ceph.mds.a:Sent signal 15 2023-08-09T14:35:48.273 INFO:tasks.ceph.mds.b:Sent signal 15 2023-08-09T14:35:48.274 INFO:tasks.ceph.mds.d:Sent signal 15 2023-08-09T14:35:48.274 INFO:tasks.ceph.mon.a:Sent signal 15 2023-08-09T14:35:48.274 INFO:tasks.ceph.mon.b:Sent signal 15 2023-08-09T14:35:48.274 INFO:tasks.ceph.mon.c:Sent signal 15 2023-08-09T14:35:48.275 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-08-09T14:35:48.275 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-08-09T14:35:48.276 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f70e7b93700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 102758) UID: 0 2023-08-09T14:35:48.276 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f70e7b93700 -1 osd.4 37 *** Got signal Terminated *** 2023-08-09T14:35:48.276 INFO:tasks.ceph.osd.4.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f70e7b93700 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:35:48.271+0000 7ff1533d7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 102760) UID: 0 2023-08-09T14:35:48.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:35:48.271+0000 7ff1533d7700 -1 osd.5 37 *** Got signal Terminated *** 2023-08-09T14:35:48.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2023-08-09T14:35:48.271+0000 7ff1533d7700 -1 osd.5 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.278 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f5c3e7a3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 102764) UID: 0 2023-08-09T14:35:48.278 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f5c3e7a3700 -1 osd.6 37 *** Got signal Terminated *** 2023-08-09T14:35:48.278 INFO:tasks.ceph.osd.6.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f5c3e7a3700 -1 osd.6 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.278 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f0c8402a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 102766) UID: 0 2023-08-09T14:35:48.278 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f0c8402a700 -1 osd.7 37 *** Got signal Terminated *** 2023-08-09T14:35:48.279 INFO:tasks.ceph.osd.7.smithi101.stderr:2023-08-09T14:35:48.271+0000 7f0c8402a700 -1 osd.7 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.279 INFO:tasks.ceph.mds.b.smithi101.stderr:2023-08-09T14:35:48.272+0000 7f806548a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 110412) UID: 0 2023-08-09T14:35:48.279 INFO:tasks.ceph.mds.b.smithi101.stderr:2023-08-09T14:35:48.272+0000 7f806548a700 -1 mds.b *** got signal Terminated *** 2023-08-09T14:35:48.279 INFO:tasks.ceph.mds.d.smithi101.stderr:2023-08-09T14:35:48.273+0000 7efca9f94700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 110413) UID: 0 2023-08-09T14:35:48.280 INFO:tasks.ceph.mds.d.smithi101.stderr:2023-08-09T14:35:48.273+0000 7efca9f94700 -1 mds.d *** got signal Terminated *** 2023-08-09T14:35:48.280 INFO:tasks.ceph.mon.b.smithi101.stderr:2023-08-09T14:35:48.274+0000 7f51fd7cf700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 102107) UID: 0 2023-08-09T14:35:48.280 INFO:tasks.ceph.mon.b.smithi101.stderr:2023-08-09T14:35:48.274+0000 7f51fd7cf700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-08-09T14:35:48.280 INFO:tasks.ceph.mon.c.smithi101.stderr:2023-08-09T14:35:48.277+0000 7fceea096700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 102108) UID: 0 2023-08-09T14:35:48.281 INFO:tasks.ceph.mon.c.smithi101.stderr:2023-08-09T14:35:48.277+0000 7fceea096700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-08-09T14:35:48.281 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:35:48.269+0000 7f802e598700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 102452) UID: 0 2023-08-09T14:35:48.281 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:35:48.269+0000 7f802e598700 -1 osd.0 37 *** Got signal Terminated *** 2023-08-09T14:35:48.282 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-08-09T14:35:48.269+0000 7f802e598700 -1 osd.0 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.282 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:35:48.270+0000 7ffb0da28700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 102459) UID: 0 2023-08-09T14:35:48.282 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:35:48.270+0000 7ffb0da28700 -1 osd.1 37 *** Got signal Terminated *** 2023-08-09T14:35:48.282 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-08-09T14:35:48.270+0000 7ffb0da28700 -1 osd.1 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.283 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:35:48.270+0000 7fdde8aa7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 102466) UID: 0 2023-08-09T14:35:48.283 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:35:48.270+0000 7fdde8aa7700 -1 osd.2 37 *** Got signal Terminated *** 2023-08-09T14:35:48.283 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-08-09T14:35:48.270+0000 7fdde8aa7700 -1 osd.2 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:35:48.271+0000 7f2e81243700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 102471) UID: 0 2023-08-09T14:35:48.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:35:48.271+0000 7f2e81243700 -1 osd.3 37 *** Got signal Terminated *** 2023-08-09T14:35:48.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-08-09T14:35:48.271+0000 7f2e81243700 -1 osd.3 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-09T14:35:48.284 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-08-09T14:35:48.272+0000 7f801bf3a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 115663) UID: 0 2023-08-09T14:35:48.284 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-08-09T14:35:48.272+0000 7f801bf3a700 -1 mds.a *** got signal Terminated *** 2023-08-09T14:35:48.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-08-09T14:35:48.273+0000 7f464dd27700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T14:35:48.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-08-09T14:35:48.274+0000 7f4653532700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 102125) UID: 0 2023-08-09T14:35:48.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-08-09T14:35:48.274+0000 7f4653532700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-09T14:35:48.476 INFO:tasks.ceph.mgr.y.smithi005.stderr:daemon-helper: command crashed with signal 15 2023-08-09T14:35:58.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:35:58.907 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:36:28.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:36:28.983 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:36:59.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:36:59.083 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:37:29.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:37:29.151 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:37:59.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:37:59.233 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:38:29.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:38:29.304 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:38:59.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:38:59.399 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:39:29.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:39:29.492 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:39:59.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:39:59.553 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:40:29.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:40:29.641 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:40:59.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:40:59.712 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:41:29.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:41:29.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:41:59.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:41:59.864 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:42:29.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:42:29.930 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:42:59.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:42:59.994 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:43:30.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:43:30.064 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:44:00.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:44:00.130 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:44:30.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:44:30.226 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:45:00.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:45:00.287 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:45:30.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:45:30.352 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:46:00.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:46:00.421 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:46:30.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:46:30.487 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:47:00.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:47:00.569 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:47:30.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:47:30.650 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:48:00.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:48:00.721 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:48:30.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:48:30.792 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:49:00.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:49:00.870 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:49:30.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:49:30.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:50:01.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:50:01.013 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:50:31.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:50:31.077 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:51:01.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:51:01.145 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:51:31.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:51:31.226 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:52:01.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:52:01.293 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:52:31.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:52:31.376 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:53:01.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:53:01.445 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:53:31.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:53:31.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:54:01.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:54:01.588 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:54:31.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:54:31.669 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:55:01.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:55:01.739 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:55:31.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:55:31.808 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:56:01.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:56:01.875 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:56:31.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:56:31.938 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:57:01.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:57:02.002 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:57:32.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:57:32.081 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:58:02.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:58:02.146 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:58:32.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:58:32.216 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:59:02.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:59:02.298 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:59:32.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T14:59:32.366 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:00:02.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:00:02.433 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:00:32.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:00:32.523 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:01:02.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:01:02.594 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:01:32.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:01:32.663 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:02:02.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:02:02.730 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:02:32.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:02:32.801 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:03:02.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:03:02.887 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:03:32.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:03:32.994 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:04:03.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:04:03.074 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:04:33.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:04:33.145 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:05:03.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:05:03.216 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:05:33.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:05:33.289 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:06:03.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:06:03.361 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:06:33.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:06:33.432 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:07:03.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:07:03.497 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:07:33.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:07:33.567 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:08:03.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:08:03.641 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:08:33.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:08:33.740 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:09:03.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:09:03.811 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:09:33.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:09:33.883 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:10:03.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:10:03.955 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:10:34.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:10:34.017 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:11:04.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:11:04.096 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:11:34.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:11:34.169 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:12:04.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:12:04.233 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:12:34.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:12:34.353 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:13:04.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:13:04.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:13:34.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:13:34.498 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:14:04.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:14:04.565 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:14:34.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:14:34.651 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:15:04.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:15:04.722 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:15:34.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:15:34.807 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:16:04.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:16:04.888 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:16:34.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:16:34.954 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:17:05.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:17:05.018 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:17:35.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:17:35.090 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:18:05.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:18:05.162 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:18:35.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:18:35.230 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:19:05.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:19:05.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:19:35.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:19:35.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:20:05.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:20:05.470 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:20:35.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:20:35.577 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:21:05.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:21:05.660 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:21:35.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:21:35.757 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:22:05.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:22:05.825 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:22:35.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:22:35.891 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:23:05.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:23:05.968 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:23:36.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:23:36.053 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:24:06.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:24:06.141 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:24:36.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:24:36.225 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:25:06.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:25:06.303 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:25:36.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:25:36.369 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:26:06.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:26:06.457 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:26:36.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:26:36.550 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:27:06.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:27:06.647 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:27:36.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:27:36.714 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:28:06.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:28:06.783 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:28:36.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:28:36.858 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:29:06.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:29:06.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:29:37.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:29:37.010 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:30:07.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:30:07.089 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:30:37.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:30:37.218 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:31:07.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:31:07.347 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:31:37.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:31:37.495 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:32:07.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:32:07.633 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:32:37.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:32:37.763 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:33:07.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:33:07.829 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:33:37.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:33:37.965 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:34:08.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:34:08.153 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:34:38.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:34:38.317 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:35:08.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:35:08.456 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:35:38.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:35:38.594 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:36:08.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:36:08.731 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:36:38.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:36:38.877 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:37:08.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:37:08.946 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:37:39.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:37:39.081 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:38:09.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:38:09.226 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:38:39.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:38:39.373 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:39:09.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:39:09.545 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:39:39.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:39:39.682 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:40:09.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:40:09.812 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:40:39.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:40:39.998 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:41:10.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:41:10.069 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:41:40.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:41:40.191 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:42:10.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:42:10.340 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:42:40.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:42:40.468 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:43:10.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:43:10.598 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:43:40.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:43:40.745 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:44:10.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:44:10.908 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:44:41.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:44:41.063 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:45:11.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:45:11.202 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:45:41.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:45:41.382 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:46:11.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:46:11.536 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:46:41.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:46:41.657 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:47:11.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:47:11.787 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:47:41.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:47:41.926 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:48:12.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:48:12.315 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:48:42.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:48:42.462 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:49:12.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:49:12.608 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:49:42.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:49:42.738 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:50:12.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:50:12.818 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:50:42.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:50:42.990 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:51:13.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:51:13.120 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:51:43.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:51:43.267 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:52:13.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:52:13.389 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:52:43.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:52:43.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:53:13.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:53:13.689 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:53:43.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:53:43.829 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:54:13.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:54:13.966 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:54:44.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:54:44.173 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:55:14.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:55:14.326 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:55:44.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:55:44.482 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:56:14.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:56:14.620 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:56:44.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:56:44.775 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:57:14.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:57:14.913 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:57:45.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:57:45.068 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:58:15.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:58:15.241 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:58:45.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:58:45.386 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:59:15.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:59:15.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:59:45.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T15:59:45.688 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:00:15.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:00:15.817 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:00:45.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:00:45.956 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:01:16.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:01:16.087 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:01:46.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:01:46.233 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:02:16.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:02:16.372 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:02:46.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:02:46.511 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:03:16.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:03:16.624 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:03:46.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:03:46.736 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:04:16.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:04:16.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:04:47.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:04:47.022 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:05:17.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:05:17.168 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:05:47.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:05:47.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:06:17.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:06:17.420 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:06:47.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:06:47.567 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:07:17.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:07:17.713 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:07:47.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:07:47.843 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:08:17.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:08:17.990 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:08:48.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:08:48.111 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:09:18.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:09:18.257 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:09:48.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:09:48.396 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:10:18.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:10:18.536 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:10:48.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:10:48.690 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:11:18.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:11:18.765 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:11:48.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:11:48.900 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:12:19.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:12:19.046 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:12:49.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:12:49.185 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:13:19.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:13:19.340 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:13:49.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:13:49.463 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:14:19.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:14:19.608 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:14:49.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:14:49.746 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:15:19.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:15:19.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:15:50.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:15:50.031 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:16:20.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:16:20.186 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:16:50.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:16:50.258 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:17:20.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:17:20.380 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:17:50.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:17:50.517 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:18:20.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:18:20.641 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:18:50.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:18:50.761 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:19:20.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:19:20.899 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:19:51.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:19:51.046 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:20:21.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:20:21.151 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:20:51.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:20:51.307 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:21:21.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:21:21.445 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:21:51.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:21:51.599 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:22:21.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:22:21.729 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:22:51.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:22:51.876 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:23:22.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:23:22.015 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:23:52.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:23:52.136 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:24:22.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:24:22.257 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:24:52.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:24:52.379 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:25:22.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:25:22.466 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:25:52.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:25:52.597 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:26:22.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:26:22.719 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:26:52.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:26:52.833 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:27:22.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:27:22.962 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:27:53.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:27:53.092 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:28:23.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:28:23.214 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:28:53.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:28:53.353 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:29:23.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:29:23.499 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:29:53.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:29:53.570 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:30:23.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:30:23.694 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:30:53.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:30:53.823 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:31:23.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:31:23.961 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:31:54.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:31:54.091 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:32:24.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:32:24.213 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:32:54.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:32:54.375 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:33:24.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:33:24.498 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:33:54.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:33:54.611 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:34:24.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:34:24.766 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:34:54.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:34:54.912 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:35:25.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:35:25.110 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:35:55.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:35:55.257 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:36:25.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:36:25.387 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:36:55.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:36:55.550 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:37:25.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:37:25.697 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:37:55.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:37:55.827 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:38:25.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:38:25.982 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:38:56.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:38:56.121 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:39:26.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:39:26.285 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:39:56.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:39:56.406 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:40:26.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:40:26.553 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:40:56.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:40:56.708 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:41:26.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:41:26.854 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:41:56.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:41:56.984 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:42:27.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:42:27.115 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:42:57.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:42:57.270 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:43:27.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:43:27.407 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:43:57.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:43:57.546 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:44:27.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:44:27.676 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:44:57.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:44:57.806 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:45:27.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:45:27.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:45:58.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:45:58.090 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:46:28.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:46:28.246 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:46:58.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:46:58.375 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:47:28.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:47:28.522 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:47:58.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:47:58.651 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:48:28.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:48:28.782 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:48:58.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:48:58.928 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:49:29.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:49:29.058 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:49:59.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:49:59.205 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:50:29.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:50:29.352 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:50:59.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:50:59.565 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:51:29.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:51:29.686 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:51:59.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:51:59.826 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:52:29.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:52:29.966 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:53:00.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:53:00.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:53:30.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:53:30.242 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:54:00.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:54:00.380 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:54:30.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:54:30.519 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:55:00.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:55:00.657 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:55:30.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:55:30.787 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:56:00.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:56:00.932 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:56:31.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:56:31.054 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:57:01.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:57:01.177 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:57:31.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:57:31.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:58:01.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:58:01.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:58:31.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:58:31.567 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:59:01.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:59:01.715 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:59:31.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T16:59:31.843 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:00:01.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:00:01.965 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:00:32.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:00:32.120 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:01:02.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:01:02.250 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:01:32.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:01:32.380 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:02:02.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:02:02.519 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:02:32.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:02:32.639 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:03:02.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:03:02.795 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:03:32.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:03:32.949 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:04:03.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:04:03.071 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:04:33.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:04:33.211 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:05:03.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:05:03.331 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:05:33.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:05:33.469 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:06:03.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:06:03.599 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:06:33.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:06:33.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:07:03.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:07:03.859 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:07:33.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:07:33.981 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:08:04.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:08:04.120 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:08:34.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:08:34.275 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:09:04.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:09:04.397 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:09:34.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:09:34.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:10:04.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:10:04.655 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:10:34.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:10:34.794 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:11:04.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:11:04.933 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:11:35.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:11:35.079 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:12:05.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:12:05.201 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:12:35.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:12:35.339 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:13:05.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:13:05.407 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:13:35.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:13:35.574 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:14:05.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:14:05.737 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:14:35.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:14:35.901 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:15:06.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:15:06.043 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:15:36.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:15:36.169 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:16:06.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:16:06.291 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:16:36.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:16:36.454 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:17:06.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:17:06.592 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:17:36.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:17:36.713 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:18:06.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:18:06.835 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:18:36.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:18:36.957 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:19:07.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:19:07.088 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:19:37.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:19:37.227 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:20:07.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:20:07.364 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:20:37.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:20:37.457 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:21:07.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:21:07.607 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:21:37.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:21:37.762 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:22:07.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:22:07.892 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:22:38.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:22:38.031 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:23:08.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:23:08.144 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:23:38.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:23:38.207 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:24:08.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:24:08.295 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:24:38.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:24:38.459 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:25:08.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:25:08.589 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:25:38.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:25:38.735 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:26:08.857 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:26:39.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:26:39.012 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:27:09.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:27:09.150 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:27:39.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:27:39.273 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:28:09.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:28:09.436 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:28:39.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:28:39.585 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:29:09.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:29:09.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:29:39.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:29:39.883 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:30:10.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:30:10.005 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:30:40.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:30:40.153 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:31:10.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:31:10.298 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:31:40.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:31:40.437 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:32:10.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:32:10.576 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:32:40.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:32:40.770 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:33:10.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:33:10.850 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:33:40.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:33:40.965 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:34:11.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:34:11.079 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:34:41.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:34:41.250 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:35:11.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:35:11.397 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:35:41.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:35:41.529 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:36:11.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:36:11.648 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:36:41.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:36:41.827 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:37:11.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:37:11.958 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:37:42.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:37:42.087 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:38:12.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:38:12.218 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:38:42.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:38:42.356 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:39:12.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:39:12.527 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:39:42.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:39:42.666 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:40:12.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:40:12.780 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:40:42.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:40:42.910 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:41:13.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:41:13.130 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:41:43.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:41:43.245 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:42:13.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:42:13.391 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:42:43.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:42:43.515 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:43:13.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:43:13.667 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:43:43.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:43:43.789 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:44:13.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:44:13.912 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:44:44.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:44:44.058 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:45:14.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:45:14.180 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:45:44.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:45:44.301 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:46:14.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:46:14.447 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:46:44.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:46:44.600 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:47:14.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:47:14.724 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:47:44.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:47:44.854 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:48:14.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:48:14.992 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:48:45.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:48:45.139 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:49:15.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:49:15.286 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:49:45.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:49:45.399 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:50:15.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:50:15.540 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:50:45.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:50:45.625 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:51:15.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:51:15.765 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:51:45.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:51:45.886 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:52:16.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:52:16.007 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:52:46.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:52:46.121 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:53:16.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:53:16.183 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:53:46.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:53:46.255 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:54:16.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:54:16.327 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:54:46.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:54:46.465 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:55:16.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:55:16.590 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:55:46.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:55:46.734 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:56:16.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:56:16.856 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:56:46.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:56:46.985 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:57:17.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:57:17.115 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:57:47.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:57:47.262 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:58:17.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:58:17.400 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:58:47.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:58:47.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:59:17.683 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:59:17.687 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:59:47.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T17:59:47.833 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:00:17.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:00:17.953 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:00:48.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:00:48.075 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:01:18.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:01:18.238 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:01:48.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:01:48.377 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:02:18.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:02:18.508 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:02:48.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:02:48.662 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:03:18.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:03:18.784 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:03:48.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:03:48.930 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:04:19.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:04:19.087 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:04:49.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:04:49.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:05:19.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:05:19.345 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:05:49.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:05:49.478 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:06:19.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:06:19.639 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:06:49.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:06:49.785 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:07:19.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:07:19.923 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:07:50.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:07:50.053 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:08:20.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:08:20.191 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:08:50.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:08:50.330 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:09:20.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:09:20.469 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:09:50.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:09:50.607 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:10:20.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:10:20.745 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:10:50.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:10:50.892 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:11:21.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:11:21.055 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:11:51.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:11:51.252 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:12:21.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:12:21.365 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:12:51.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:12:51.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:13:21.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:13:21.550 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:13:51.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:13:51.697 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:14:21.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:14:21.844 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:14:51.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:14:51.990 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:15:22.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:15:22.120 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:15:52.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:15:52.276 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:16:22.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:16:22.422 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:16:52.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:16:52.560 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:17:22.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:17:22.711 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:17:52.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:17:52.836 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:18:22.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:18:22.967 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:18:53.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:18:53.130 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:19:23.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:19:23.269 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:19:53.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:19:53.406 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:20:23.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:20:23.546 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:20:53.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:20:53.675 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:21:23.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:21:23.805 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:21:53.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:21:53.918 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:22:24.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:22:24.073 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:22:54.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:22:54.203 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:23:24.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:23:24.326 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:23:54.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:23:54.447 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:24:24.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:24:24.586 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:24:54.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:24:54.715 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:25:24.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:25:24.845 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:25:54.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:25:54.992 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:26:25.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:26:25.122 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:26:55.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:26:55.251 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:27:25.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:27:25.373 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:27:55.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:27:55.486 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:28:25.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:28:25.608 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:28:55.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:28:55.746 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:29:25.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:29:25.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:29:56.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:29:56.035 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:30:26.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:30:26.099 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:30:56.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:30:56.242 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:31:26.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:31:26.372 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:31:56.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:31:56.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:32:26.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:32:26.640 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:32:56.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:32:56.834 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:33:26.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:33:26.992 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:33:57.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:33:57.130 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:34:27.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:34:27.268 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:34:57.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:34:57.340 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:35:27.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:35:27.495 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:35:57.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:35:57.688 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:36:27.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:36:27.813 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:36:57.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:36:57.943 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:37:28.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:37:28.066 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:37:58.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:37:58.212 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:38:28.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:38:28.334 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:38:58.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:38:58.463 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:39:28.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:39:28.610 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:39:58.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:39:58.765 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:40:28.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:40:28.904 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:40:59.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:40:59.041 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:41:29.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:41:29.180 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:41:59.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:41:59.310 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:42:29.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:42:29.448 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:42:59.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:42:59.587 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:43:29.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:43:29.718 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:43:59.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:43:59.855 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:44:29.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:44:30.003 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:45:00.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:45:00.140 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:45:30.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:45:30.279 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:46:00.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:46:00.417 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:46:30.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:46:30.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:47:00.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:47:00.676 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:47:30.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:47:30.831 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:48:00.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:48:00.903 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:48:31.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:48:31.025 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:49:01.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:49:01.163 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:49:31.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:49:31.293 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:50:01.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:50:01.439 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:50:31.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:50:31.604 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:51:01.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:51:01.775 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:51:31.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:51:31.922 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:52:02.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:52:02.043 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:52:32.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:52:32.181 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:53:02.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:53:02.302 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:53:32.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:53:32.466 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:54:02.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:54:02.597 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:54:32.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:54:34.263 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:55:04.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:55:04.414 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:55:34.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:55:34.528 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:56:04.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:56:04.683 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:56:34.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:56:34.838 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:57:04.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:57:04.975 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:57:35.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:57:35.122 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:58:05.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:58:05.186 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:58:35.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:58:35.332 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:59:05.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:59:05.463 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:59:35.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T18:59:35.617 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:00:05.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:00:05.755 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:00:35.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:00:35.885 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:01:06.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:01:06.041 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:01:36.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:01:36.179 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:02:06.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:02:06.286 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:02:36.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:02:36.407 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:03:06.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:03:06.537 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:03:36.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:03:36.666 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:04:06.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:04:06.797 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:04:36.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:04:36.926 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:05:07.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:05:07.081 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:05:37.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:05:37.219 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:06:07.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:06:07.374 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:06:37.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:06:37.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:07:07.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:07:07.692 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:07:37.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:07:37.831 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:08:07.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:08:07.960 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:08:38.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:08:38.132 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:09:08.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:09:08.271 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:09:38.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:09:38.409 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:10:08.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:10:08.564 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:10:38.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:10:38.751 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:11:08.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:11:08.837 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:11:38.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:11:38.903 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:12:09.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:12:09.051 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:12:39.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:12:39.197 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:13:09.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:13:09.335 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:13:39.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:13:39.449 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:14:09.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:14:09.595 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:14:39.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:14:39.726 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:15:09.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:15:09.879 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:15:39.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:15:40.002 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:16:10.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:16:10.115 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:16:40.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:16:40.262 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:17:10.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:17:10.405 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:17:40.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:17:40.539 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:18:10.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:18:10.661 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:18:40.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:18:40.816 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:19:10.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:19:10.962 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:19:41.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:19:41.091 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:20:11.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:20:11.239 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:20:41.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:20:41.375 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:21:11.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:21:11.541 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:21:41.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:21:41.663 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:22:11.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:22:11.809 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:22:41.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:22:41.964 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:23:12.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:23:12.093 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:23:42.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:23:42.207 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:24:12.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:24:12.342 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:24:42.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:24:42.408 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:25:12.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:25:12.537 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:25:42.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:25:42.610 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:26:12.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:26:12.759 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:26:42.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:26:42.896 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:27:13.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:27:13.042 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:27:43.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:27:43.172 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:28:13.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:28:13.302 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:28:43.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:28:43.431 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:29:13.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:29:13.554 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:29:43.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:29:43.717 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:30:13.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:30:13.882 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:30:44.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:30:44.018 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:31:14.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:31:14.173 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:31:44.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:31:44.302 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:32:14.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:32:14.441 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:32:44.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:32:44.571 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:33:14.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:33:14.711 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:33:44.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:33:44.865 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:34:14.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:34:14.995 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:34:45.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:34:45.141 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:35:15.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:35:15.297 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:35:45.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:35:45.434 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:36:15.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:36:15.585 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:36:45.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:36:45.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:37:15.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:37:15.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:37:46.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:37:46.019 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:38:16.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:38:16.143 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:38:46.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:38:46.274 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:39:16.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:39:16.411 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:39:46.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:39:46.550 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:40:16.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:40:16.688 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:40:46.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:40:46.836 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:41:16.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:41:16.925 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:41:47.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:41:47.073 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:42:17.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:42:17.159 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:42:47.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:42:47.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:43:17.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:43:17.443 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:43:47.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:43:47.590 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:44:17.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:44:17.728 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:44:47.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:44:47.858 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:45:18.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:45:18.005 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:45:48.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:45:48.161 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:46:18.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:46:18.298 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:46:48.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:46:48.437 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:47:18.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:47:18.574 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:47:48.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:47:48.688 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:48:18.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:48:18.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:48:48.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:48:48.907 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:49:19.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:49:19.054 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:49:49.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:49:49.176 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:50:19.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:50:19.338 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:50:49.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:50:49.494 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:51:19.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:51:19.623 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:51:49.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:51:49.770 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:52:19.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:52:19.916 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:52:50.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:52:50.046 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:53:20.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:53:20.177 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:53:50.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:53:50.302 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:54:20.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:54:20.437 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:54:50.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:54:50.558 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:55:20.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:55:20.697 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:55:50.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:55:50.868 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:56:21.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:56:21.007 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:56:51.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:56:51.155 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:57:21.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:57:21.307 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:57:51.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:57:51.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:58:21.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:58:21.551 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:58:51.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:58:51.690 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:59:21.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:59:21.837 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:59:51.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T19:59:51.903 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:00:22.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:00:22.043 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:00:52.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:00:52.169 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:01:22.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:01:22.258 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:01:52.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:01:52.386 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:02:22.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:02:22.533 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:02:52.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:02:52.663 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:03:22.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:03:22.802 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:03:52.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:03:52.906 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:04:23.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:04:23.045 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:04:53.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:04:53.184 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:05:23.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:05:23.339 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:05:53.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:05:53.485 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:06:23.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:06:23.607 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:06:53.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:06:53.736 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:07:23.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:07:23.875 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:07:53.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:07:53.996 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:08:24.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:08:24.110 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:08:54.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:08:54.240 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:09:24.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:09:24.403 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:09:54.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:09:54.549 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:10:24.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:10:24.679 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:10:54.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:10:54.801 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:11:24.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:11:24.939 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:11:55.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:11:55.069 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:12:25.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:12:25.208 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:12:55.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:12:55.279 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:13:25.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:13:25.412 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:13:55.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:13:55.584 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:14:25.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:14:25.731 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:14:55.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:14:55.869 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:15:26.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:15:26.023 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:15:56.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:15:56.153 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:16:26.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:16:26.312 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:16:56.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:16:56.430 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:17:26.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:17:26.609 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:17:56.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:17:56.740 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:18:26.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:18:26.878 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:18:57.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:18:57.036 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:19:27.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:19:27.180 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:19:57.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:19:57.310 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:20:27.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:20:27.474 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:20:57.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:20:57.620 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:21:27.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:21:27.760 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:21:57.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:21:57.902 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:22:28.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:22:28.051 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:22:58.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:22:58.190 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:23:28.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:23:28.321 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:23:58.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:23:58.475 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:24:28.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:24:28.631 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:24:58.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:24:58.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:25:28.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:25:28.923 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:25:59.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:25:59.045 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:26:29.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:26:29.175 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:26:59.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:26:59.314 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:27:29.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:27:29.435 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:27:59.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:27:59.581 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:28:29.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:28:29.696 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:28:59.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:28:59.850 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:29:29.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:29:29.972 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:30:00.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:30:00.110 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:30:30.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:30:30.274 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:31:00.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:31:00.395 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:31:30.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:31:30.516 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:32:00.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:32:00.638 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:32:30.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:32:30.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:33:00.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:33:00.923 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:33:31.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:33:31.044 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:34:01.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:34:01.191 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:34:31.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:34:31.342 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:35:01.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:35:01.468 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:35:31.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:35:31.632 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:36:01.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:36:01.754 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:36:31.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:36:31.885 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:37:02.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:37:02.006 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:37:32.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:37:32.136 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:38:02.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:38:02.282 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:38:32.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:38:32.412 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:39:02.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:39:02.551 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:39:32.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:39:32.672 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:40:02.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:40:02.836 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:40:32.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:40:32.975 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:41:03.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:41:03.121 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:41:33.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:41:33.243 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:42:03.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:42:03.364 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:42:33.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:42:33.485 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:43:03.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:43:03.607 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:43:33.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:43:33.738 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:44:03.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:44:03.876 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:44:34.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:44:34.006 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:45:04.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:45:04.135 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:45:34.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:45:34.282 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:46:04.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:46:04.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:46:34.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:46:34.558 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:47:04.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:47:04.707 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:47:34.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:47:34.844 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:48:04.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:48:04.941 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:48:35.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:48:35.097 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:49:05.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:49:05.226 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:49:35.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:49:35.373 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:50:05.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:50:05.502 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:50:35.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:50:35.658 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:51:05.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:51:05.804 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:51:35.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:51:35.934 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:52:06.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:52:06.080 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:52:36.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:52:36.211 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:53:06.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:53:06.365 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:53:36.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:53:36.504 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:54:06.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:54:06.627 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:54:36.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:54:36.774 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:55:06.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:55:06.902 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:55:37.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:55:37.066 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:56:07.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:56:07.197 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:56:37.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:56:37.351 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:57:07.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:57:07.416 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:57:37.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:57:37.578 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:58:07.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:58:07.709 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:58:37.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:58:37.781 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:59:07.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:59:07.920 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:59:37.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T20:59:37.994 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:00:08.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:00:08.118 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:00:38.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:00:38.287 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:01:08.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:01:08.462 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:01:38.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:01:38.593 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:02:08.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:02:08.794 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:02:38.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:02:38.927 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:03:08.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:03:08.999 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:03:39.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:03:39.162 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:04:09.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:04:09.300 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:04:39.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:04:39.422 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:05:09.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:05:09.552 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:05:39.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:05:39.706 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:06:09.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:06:09.854 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:06:39.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:06:39.983 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:07:10.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:07:10.129 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:07:40.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:07:40.269 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:08:10.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:08:10.400 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:08:40.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:08:40.562 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:09:10.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:09:10.684 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:09:40.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:09:40.813 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:10:10.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:10:10.926 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:10:41.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:10:41.095 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:11:11.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:11:11.244 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:11:41.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:11:41.375 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:12:11.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:12:11.489 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:12:41.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:12:41.627 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:13:11.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:13:11.690 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:13:41.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:13:41.845 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:14:11.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:14:11.974 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:14:42.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:14:42.096 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:15:12.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:15:12.226 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:15:42.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:15:42.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:16:12.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:16:12.536 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:16:42.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:16:42.675 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:17:12.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:17:12.822 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:17:42.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:17:42.943 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:18:13.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:18:13.073 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:18:43.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:18:43.203 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:19:13.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:19:13.333 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:19:43.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:19:43.447 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:20:13.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:20:13.584 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:20:43.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:20:43.732 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:21:13.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:21:13.862 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:21:44.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:21:44.012 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:22:14.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:22:14.148 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:22:44.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:22:44.293 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:23:14.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:23:14.366 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:23:44.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:23:44.487 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:24:14.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:24:14.611 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:24:44.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:24:44.739 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:25:14.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:25:14.885 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:25:45.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:25:45.040 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:26:15.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:26:15.192 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:26:45.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:26:45.322 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:27:15.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:27:15.463 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:27:45.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:27:45.536 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:28:15.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:28:15.650 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:28:45.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:28:45.770 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:29:15.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:29:15.929 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:29:46.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:29:46.038 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:30:16.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:30:16.176 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:30:46.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:30:46.324 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:31:16.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:31:16.380 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:31:46.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:31:46.524 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:32:16.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:32:16.655 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:32:46.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:32:46.785 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:33:16.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:33:16.932 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:33:47.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:33:47.070 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:34:17.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:34:17.216 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:34:47.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:34:47.354 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:35:17.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:35:17.476 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:35:47.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:35:47.615 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:36:17.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:36:17.753 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:36:47.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:36:47.891 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:37:18.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:37:18.021 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:37:48.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:37:48.143 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:38:18.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:38:18.291 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:38:48.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:38:48.448 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:39:18.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:39:18.592 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:39:48.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:39:48.738 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:40:18.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:40:18.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:40:49.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:40:49.057 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:41:19.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:41:19.202 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:41:49.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:41:49.341 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:42:19.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:42:19.479 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:42:49.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:42:49.636 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:43:19.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:43:19.757 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:43:49.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:43:49.911 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:44:20.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:44:20.034 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:44:50.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:44:50.165 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:45:20.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:45:20.318 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:45:50.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:45:50.465 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:46:20.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:46:20.611 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:46:50.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:46:50.844 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:47:20.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:47:20.996 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:47:51.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:47:51.125 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:48:21.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:48:21.256 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:48:51.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:48:51.369 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:49:21.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:49:21.508 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:49:51.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:49:51.573 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:50:21.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:50:21.717 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:50:51.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:50:51.899 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:51:22.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:51:22.036 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:51:52.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:51:52.174 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:52:22.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:52:22.305 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:52:52.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:52:52.426 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:53:22.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:53:22.585 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:53:52.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:53:52.736 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:54:22.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:54:22.914 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:54:53.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:54:53.029 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:55:23.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:55:23.177 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:55:53.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:55:53.322 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:56:23.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:56:23.453 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:56:53.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:56:53.575 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:57:23.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:57:23.704 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:57:53.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:57:53.852 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:58:23.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:58:23.998 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:58:54.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:58:54.128 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:59:24.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:59:24.266 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:59:54.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T21:59:54.396 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:00:24.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:00:24.535 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:00:54.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:00:54.698 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:01:24.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:01:24.820 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:01:54.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:01:55.839 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:02:25.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:02:25.972 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:02:56.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:02:56.118 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:03:26.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:03:26.256 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:03:56.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:03:56.329 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:04:26.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:04:26.475 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:04:56.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:04:56.596 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:05:26.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:05:26.726 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:05:56.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:05:56.881 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:06:27.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:06:27.011 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:06:57.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:06:57.133 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:07:27.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:07:27.246 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:07:57.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:07:57.376 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:08:27.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:08:27.531 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:08:57.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:08:57.677 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:09:27.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:09:27.807 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:09:57.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:09:57.954 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:10:28.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:10:28.109 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:10:58.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:10:58.232 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:11:28.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:11:28.387 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:11:58.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:11:58.533 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:12:28.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:12:28.654 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:12:58.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:12:58.836 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:13:28.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:13:28.973 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:13:59.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:13:59.137 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:14:29.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:14:29.267 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:14:59.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:14:59.387 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:15:29.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:15:29.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:15:59.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:15:59.664 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:16:29.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:16:29.794 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:16:59.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:16:59.924 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:17:30.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:17:30.072 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:18:00.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:18:00.200 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:18:30.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:18:30.331 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:19:00.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:19:00.462 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:19:30.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:19:30.583 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:20:00.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:20:00.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:20:30.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:20:30.851 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:21:00.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:21:00.990 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:21:31.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:21:31.046 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:22:01.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:22:01.173 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:22:31.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:22:31.295 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:23:01.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:23:01.425 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:23:31.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:23:31.564 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:24:01.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:24:01.694 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:24:31.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:24:31.817 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:25:01.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:25:01.945 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:25:32.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:25:32.084 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:26:02.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:26:02.230 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:26:32.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:26:32.360 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:27:02.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:27:02.506 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:27:32.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:27:32.645 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:28:02.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:28:02.776 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:28:32.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:28:32.930 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:29:03.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:29:03.043 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:29:33.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:29:33.173 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:30:03.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:30:03.303 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:30:33.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:30:33.458 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:31:03.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:31:03.580 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:31:33.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:31:33.735 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:32:03.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:32:03.865 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:32:33.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:32:33.986 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:33:04.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:33:04.108 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:33:34.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:33:34.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:34:04.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:34:04.351 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:34:34.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:34:34.423 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:35:04.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:35:04.516 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:35:34.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:35:34.666 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:36:04.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:36:04.788 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:36:34.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:36:34.935 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:37:05.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:37:05.082 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:37:35.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:37:35.219 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:38:05.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:38:05.287 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:38:35.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:38:35.405 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:39:05.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:39:05.552 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:39:35.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:39:35.691 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:40:05.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:40:05.812 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:40:35.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:40:35.967 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:41:06.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:41:06.121 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:41:36.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:41:36.251 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:42:06.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:42:06.390 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:42:36.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:42:36.511 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:43:06.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:43:06.666 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:43:36.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:43:36.796 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:44:06.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:44:06.918 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:44:37.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:44:37.073 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:45:07.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:45:07.194 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:45:37.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:45:37.367 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:46:07.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:46:07.530 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:46:37.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:46:37.667 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:47:07.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:47:07.805 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:47:37.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:47:37.926 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:48:08.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:48:08.082 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:48:38.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:48:38.221 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:49:08.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:49:08.376 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:49:38.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:49:38.515 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:50:08.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:50:08.661 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:50:38.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:50:38.816 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:51:08.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:51:08.962 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:51:39.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:51:39.100 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:52:09.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:52:09.185 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:52:39.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:52:39.319 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:53:09.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:53:09.475 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:53:39.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:53:39.604 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:54:09.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:54:09.751 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:54:39.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:54:39.880 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:55:10.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:55:10.027 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:55:40.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:55:40.182 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:56:10.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:56:10.337 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:56:40.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:56:40.500 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:57:10.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:57:10.647 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:57:40.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:57:40.785 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:58:10.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:58:10.860 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:58:41.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:58:41.007 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:59:11.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:59:11.166 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:59:41.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T22:59:41.316 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:00:11.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:00:11.452 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:00:41.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:00:41.573 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:01:11.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:01:11.721 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:01:41.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:01:41.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:02:12.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:02:12.005 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:02:42.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:02:42.143 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:03:12.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:03:12.274 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:03:42.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:03:42.395 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:04:12.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:04:12.534 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:04:42.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:04:42.679 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:05:12.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:05:12.818 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:05:42.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:05:42.932 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:06:13.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:06:13.070 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:06:43.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:06:43.208 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:07:13.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:07:13.329 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:07:43.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:07:43.469 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:08:13.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:08:13.547 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:08:43.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:08:43.686 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:09:13.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:09:13.849 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:09:43.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:09:43.988 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:10:14.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:10:14.118 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:10:44.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:10:44.248 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:11:14.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:11:14.404 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:11:44.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:11:44.554 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:12:14.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:12:14.696 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:12:44.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:12:44.826 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:13:14.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:13:14.961 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:13:45.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:13:45.086 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:14:15.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:14:15.250 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:14:45.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:14:45.387 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:15:15.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:15:15.518 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:15:45.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:15:45.639 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:16:15.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:16:15.794 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:16:45.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:16:45.949 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:17:16.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:17:16.104 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:17:46.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:17:46.234 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:18:16.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:18:16.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:18:46.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:18:46.534 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:19:16.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:19:16.690 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:19:46.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:19:46.813 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:20:16.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:20:16.950 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:20:47.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:20:47.106 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:21:17.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:21:17.245 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:21:47.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:21:47.399 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:22:17.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:22:17.571 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:22:47.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:22:47.719 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:23:17.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:23:17.892 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:23:48.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:23:48.027 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:24:18.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:24:18.174 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:24:48.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:24:48.287 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:25:18.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:25:18.434 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:25:48.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:25:48.564 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:26:18.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:26:18.728 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:26:48.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:26:48.858 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:27:18.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:27:18.990 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:27:49.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:27:49.142 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:28:19.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:28:19.298 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:28:49.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:28:49.427 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:29:19.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:29:19.558 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:29:49.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:29:49.687 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:30:19.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:30:19.818 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:30:49.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:30:49.973 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:31:20.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:31:20.118 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:31:50.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:31:50.240 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:32:20.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:32:20.362 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:32:50.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:32:50.525 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:33:20.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:33:20.664 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:33:50.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:33:50.786 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:34:20.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:34:20.907 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:34:51.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:34:51.047 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:35:21.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:35:21.185 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:35:51.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:35:51.315 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:36:21.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:36:21.454 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:36:51.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:36:51.617 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:37:21.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:37:21.771 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:37:51.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:37:51.935 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:38:22.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:38:22.048 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:38:52.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:38:52.170 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:39:22.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:39:22.296 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:39:52.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:39:52.441 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:40:22.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:40:22.569 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:40:52.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:40:52.665 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:41:22.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:41:22.829 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:41:52.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:41:52.992 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:42:23.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:42:23.139 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:42:53.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:42:53.293 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:43:23.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:43:23.424 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:43:53.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:43:53.570 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:44:23.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:44:23.747 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:44:53.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:44:53.889 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:45:24.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:45:24.014 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:45:54.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:45:54.165 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:46:24.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:46:24.298 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:46:54.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:46:54.444 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:47:24.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:47:24.593 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:47:54.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:47:54.678 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:48:24.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:48:24.816 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:48:54.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:48:54.978 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:49:25.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:49:25.117 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:49:55.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:49:55.271 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:50:25.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:50:25.427 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:50:55.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:50:55.572 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:51:25.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:51:25.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:51:55.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:51:55.875 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:52:26.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:52:26.034 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:52:56.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:52:56.151 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:53:26.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:53:26.281 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:53:56.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:53:56.436 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:54:26.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:54:26.566 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:54:56.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:54:56.721 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:55:26.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:55:26.859 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:55:56.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:55:56.998 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:56:27.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:56:27.144 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:56:57.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:56:57.258 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:57:27.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:57:27.379 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:57:57.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:57:57.493 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:58:27.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:58:27.631 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:58:57.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:58:57.753 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:59:27.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:59:27.884 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:59:58.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T23:59:58.016 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:00:28.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:00:28.143 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:00:58.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:00:58.274 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:01:28.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:01:28.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:01:58.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:01:58.602 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:02:28.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:02:28.748 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:02:58.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:02:58.818 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:03:28.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:03:28.959 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:03:59.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:03:59.096 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:04:29.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:04:29.234 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:04:59.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:04:59.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:05:29.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:05:29.510 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:05:59.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:05:59.633 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:06:29.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:06:29.794 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:06:59.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:06:59.942 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:07:30.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:07:30.122 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:08:00.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:08:00.270 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:08:30.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:08:30.429 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:09:00.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:09:00.555 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:09:30.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:09:30.694 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:10:00.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:10:00.847 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:10:30.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:10:30.986 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:11:01.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:11:01.150 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:11:31.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:11:31.308 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:12:01.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:12:01.459 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:12:31.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:12:31.588 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:13:01.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:13:01.727 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:13:31.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:13:31.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:14:01.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:14:01.978 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:14:32.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:14:32.108 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:15:02.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:15:02.263 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:15:32.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:15:32.377 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:16:02.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:16:02.507 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:16:32.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:16:32.644 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:17:02.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:17:02.792 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:17:32.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:17:32.930 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:18:03.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:18:03.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:18:33.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:18:33.249 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:19:03.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:19:03.386 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:19:33.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:19:33.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:20:03.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:20:03.663 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:20:33.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:20:33.818 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:21:03.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:21:03.947 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:21:34.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:21:34.094 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:22:04.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:22:04.225 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:22:34.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:22:34.371 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:23:04.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:23:04.509 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:23:34.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:23:34.647 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:24:04.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:24:04.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:24:34.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:24:34.907 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:25:05.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:25:05.054 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:25:35.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:25:35.184 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:26:05.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:26:05.305 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:26:35.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:26:35.469 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:27:05.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:27:05.607 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:27:35.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:27:35.736 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:28:05.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:28:05.815 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:28:35.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:28:35.964 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:29:06.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:29:06.085 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:29:36.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:29:36.165 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:30:06.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:30:06.311 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:30:36.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:30:36.441 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:31:06.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:31:06.513 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:31:36.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:31:36.652 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:32:06.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:32:06.802 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:32:36.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:32:36.952 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:33:07.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:33:07.091 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:33:37.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:33:37.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:34:07.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:34:07.377 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:34:37.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:34:37.523 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:35:07.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:35:07.661 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:35:37.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:35:37.743 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:36:07.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:36:07.898 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:36:38.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:36:38.061 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:37:08.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:37:08.191 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:37:38.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:37:38.346 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:38:08.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:38:08.485 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:38:38.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:38:38.625 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:39:08.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:39:08.782 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:39:38.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:39:38.908 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:40:09.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:40:09.038 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:40:39.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:40:39.106 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:41:09.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:41:09.256 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:41:39.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:41:39.420 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:42:09.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:42:09.549 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:42:39.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:42:39.680 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:43:09.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:43:09.810 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:43:39.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:43:39.964 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:44:10.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:44:10.104 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:44:40.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:44:40.233 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:45:10.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:45:10.371 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:45:40.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:45:40.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:46:10.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:46:10.672 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:46:40.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:46:40.767 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:47:10.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:47:10.900 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:47:41.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:47:41.041 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:48:11.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:48:11.099 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:48:41.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:48:41.257 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:49:11.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:49:11.395 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:49:41.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:49:41.605 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:50:11.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:50:11.738 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:50:41.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:50:41.868 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:51:12.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:51:12.023 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:51:42.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:51:42.178 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:52:12.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:52:12.307 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:52:42.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:52:42.438 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:53:12.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:53:12.578 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:53:42.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:53:42.682 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:54:12.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:54:12.811 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:54:42.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:54:42.950 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:55:13.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:55:13.087 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:55:43.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:55:43.150 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:56:13.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:56:13.280 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:56:43.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:56:43.435 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:57:13.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:57:13.599 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:57:43.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:57:43.729 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:58:13.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:58:13.876 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:58:44.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:58:44.007 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:59:14.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:59:14.145 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:59:44.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T00:59:44.279 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:00:14.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:00:14.420 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:00:44.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:00:44.551 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:01:14.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:01:14.673 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:01:44.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:01:44.819 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:02:14.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:02:14.892 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:02:44.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:02:44.976 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:03:15.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:03:15.109 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:03:45.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:03:45.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:04:15.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:04:15.390 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:04:45.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:04:45.507 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:05:15.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:05:15.645 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:05:45.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:05:45.722 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:06:15.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:06:15.873 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:06:46.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:06:46.010 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:07:16.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:07:16.149 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:07:46.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:07:46.299 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:08:16.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:08:16.449 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:08:46.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:08:46.583 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:09:16.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:09:16.710 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:09:46.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:09:46.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:10:16.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:10:16.979 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:10:47.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:10:47.125 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:11:17.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:11:17.313 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:11:47.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:11:47.462 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:12:17.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:12:17.591 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:12:47.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:12:47.720 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:13:17.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:13:17.842 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:13:47.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:13:47.922 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:14:18.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:14:18.069 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:14:48.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:14:48.208 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:15:18.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:15:18.338 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:15:48.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:15:48.492 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:16:18.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:16:18.630 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:16:48.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:16:48.785 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:17:18.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:17:18.915 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:17:49.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:17:49.070 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:18:19.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:18:19.192 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:18:49.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:18:49.323 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:19:19.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:19:19.394 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:19:49.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:19:49.524 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:20:19.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:20:19.671 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:20:49.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:20:49.833 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:21:19.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:21:19.965 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:21:50.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:21:50.110 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:22:20.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:22:20.257 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:22:50.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:22:50.388 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:23:20.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:23:20.551 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:23:50.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:23:50.672 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:24:20.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:24:20.810 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:24:50.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:24:50.957 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:25:21.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:25:21.087 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:25:51.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:25:51.259 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:26:21.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:26:21.389 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:26:51.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:26:51.544 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:27:21.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:27:21.665 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:27:51.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:27:51.803 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:28:21.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:28:21.968 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:28:52.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:28:52.097 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:29:22.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:29:22.261 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:29:52.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:29:52.416 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:30:22.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:30:22.570 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:30:52.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:30:52.734 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:31:22.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:31:22.881 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:31:53.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:31:53.027 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:32:23.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:32:23.182 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:32:53.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:32:53.328 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:33:23.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:33:23.484 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:33:53.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:33:53.623 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:34:23.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:34:23.761 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:34:53.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:34:53.891 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:35:24.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:35:24.048 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:35:54.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:35:54.234 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:36:24.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:36:24.355 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:36:54.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:36:54.493 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:37:24.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:37:24.640 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:37:54.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:37:54.778 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:38:24.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:38:24.934 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:38:55.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:38:55.063 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:39:25.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:39:25.210 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:39:55.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:39:55.356 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:40:25.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:40:25.495 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:40:55.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:40:55.600 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:41:25.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:41:25.746 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:41:55.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:41:55.901 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:42:26.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:42:26.034 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:42:56.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:42:56.154 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:43:26.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:43:26.291 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:43:56.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:43:56.414 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:44:26.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:44:26.558 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:44:56.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:44:56.881 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:45:27.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:45:27.003 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:45:57.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:45:57.136 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:46:27.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:46:27.314 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:46:57.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:46:57.460 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:47:27.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:47:27.531 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:47:57.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:47:57.653 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:48:27.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:48:27.767 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:48:57.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:48:57.888 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:49:27.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:49:28.000 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:49:58.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:49:58.147 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:50:28.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:50:28.286 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:50:58.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:50:58.407 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:51:28.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:51:28.537 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:51:58.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:51:58.675 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:52:28.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:52:28.805 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:52:58.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:52:58.918 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:53:29.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:53:29.040 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:53:59.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:53:59.113 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:54:29.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:54:29.184 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:54:59.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:54:59.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:55:29.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:55:29.461 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:55:59.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:55:59.615 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:56:29.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:56:29.745 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:56:59.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:56:59.884 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:57:30.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:57:30.021 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:58:00.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:58:00.169 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:58:30.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:58:30.315 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:59:00.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:59:00.462 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:59:30.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T01:59:30.600 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:00:00.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:00:00.722 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:00:30.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:00:30.868 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:01:01.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:01:01.016 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:01:31.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:01:31.171 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:02:01.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:02:01.324 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:02:31.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:02:32.045 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:03:02.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:03:02.177 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:03:32.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:03:32.249 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:04:02.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:04:02.403 DEBUG:teuthology.orchestra.run.smithi101:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T02:04:15.702 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-08-10T02:04:15.703 DEBUG:teuthology.task.console_log:Killing console logger for smithi005 2023-08-10T02:04:15.704 DEBUG:teuthology.task.console_log:Killing console logger for smithi101 2023-08-10T02:04:15.704 DEBUG:teuthology.exit:Finished running handlers